TANK ORNER 


TORTES 
TN 
ANALYSTS 


Topics in Analysis 


T. W. Korner 
August 11, 2022 


Small print This course is not intended as a foundation for further courses, so the 
lecturer is allowed substantial flexibility. Exam questions will be set on the course as given 
(so, if I do not have time to cover everything in these notes, the topics examined will be 
those actually lectured) and will only cover topics in these notes. Unless there is more 
time to spare than I expect, I will not talk about topological spaces but confine myself to 
ordinary Euclidean spaces R”, C and complete metric spaces. 

These notes lay out the results of the course. There is a separate set of notes giving 
the associated proofs, but those notes are intended for home use and not as a means of 
following the live lectures. 

I can provide some notes on the exercises for supervisors by e-mail. The exercises 
themselves form sections 18 to 21 of these notes. 

These notes are written in ATX 2¢ and should be available in tex, ps, pdf and dvi 
format from my home page 


http://www.dpmms.cam.ac.uk/~ twk/ 


Contents 

1 Metric spaces 

2 Compact sets in Euclidean Space 
3 Laplace’s equation 

4 Fixed points 

5 Non-zero sum games 

6 Dividing the pot 

7 Approximation by polynomials 
8 Best approximation by polynomials 
9 Gaussian quadrature 

10 Distance and compact sets 

11 Runge’s theorem 

12 Odd numbers 

13 The Baire category theorem 

14 Continued fractions 

15 Continued fractions (continued) 
16 A nice, but starred, formula 

17 Winding numbers 

18 Question sheet 1 

19 Question sheet 2 

20 Question Sheet 3 


21 Question sheet 4 


1 Metric spaces 


This section is devoted to fairly formal preliminaries. Things get more inter- 
esting in the next section and the course gets fully under way in the third. 
Both those students who find the early material worryingly familiar and those 
who find it worryingly unfamiliar are asked to suspend judgement until then. 

Most Part II students will be familiar with the notion of a metric space. 


Definition 1.1. Suppose that X is a non-empty set and d: X? > R is a 
function which obeys the following rules. 

(i) d(z,y) > 0 for alla, ye X. 

(ii) d(x, y) = 0 af and only if x = y. 

(iit) d(x, y) =d(y, x) for allz,yEX. 

(iv) d(x, y) + d(y, z) > d(x, z) for all x,y,z EX. 

Then we say that d is a metric on X and that (X,d) is a metric space. 


For most of the course we shall be concerned with metrics which you 
already know well. 


Lemma 1.2. (i) Consider R". If we take d to be ordinary Euclidean distance 


4 1/2 
d(x, y) = ||k—yll = (> |zj — ut] 


j=1 


then (IR",d) is a metric space. We refer to this space as Euclidean space. 
(ii) Consider C. If we take d(z,w) = |z — w|, then (C,d) is a metric 
space. 


Proof. Proved in previous courses (and set as Exercise 18.1). 


The next definitions work in any metric space, but you can concentrate 
on what they mean for ordinary Euclidean space. 


Definition 1.3. If (X,d) is a metric spacer, € X, x € X andd(xp, x) > 0, 
then we say that tpn > x asn— oo. 


Definition 1.4. If (X,d) is a metric space x € X andr > 0, then we write 
B(a,r) ={y EX : d(x,y) <7} 


and call B(x,r) the open ball of radius r with centre x. 


Definition 1.5. Let (X,d) be a metric space. 
(i) We say that a subset E of X is closed if, whenever tz, € E and 
Le, > x, it follows that x € E. 


(ii) We say that a subset U of X is open if, whenever u € U, we can find 
ad >0 such that B(u,d) CU. 


Exercise 1.6. (i) [fx €¢ X andr > 0, then B(x,r) is open in the sense of 
Definition 1.5. 
(ii) Ifx € X andr > 0, then the set 


B(x,r) = {ye X : d(x,y) <r} 
is closed. (Naturally enough, we call B(x,r) a closed ball.) 
(iii) If E is closed, then X \ E is open. 
(iv) If E is open then X \ E is closed. 


We recall (without proof) the following important results from 1A. 


Theorem 1.7. [Cauchy criterion] A sequence a, € R converges if and 
only if, given e > 0, we can find an N(e) such that |a, — am| < € for all 
n,m > N(e) 


Generalisation leads us to the following definitions. 


Definition 1.8. If (X,d) is a metric space, then a sequence (an) with an € X 
is called a Cauchy sequence if, given « > 0, we can find an N(e) such that 
A(an, Gm) < € for alln, m > N(e). 


Definition 1.9. We say that a metric space (X,d) is complete if every 
Cauchy sequence converges. 


Exercise 1.10. Show that if (X,d) is a metric space (complete or not), then 
every convergent sequence is Cauchy. 


We note the following very useful remarks. 


Lemma 1.11. Let (X,d) be a metric space. 

(i) If a Cauchy sequence x, in (X,d) has a convergent subsequence with 
limit x, then tp, —> x. 

(ii) Let €, > 0 and €é, > 0 as n > oo. If (X,d) has the property 
that, whenever d(2n,2n41) < €n forn > 1, it follows that the sequence Xp 
converges, then (X,d) is complete. 


Lemma 1.11 (ii) is most useful when we have }>~, €, convergent, for 
example if €, = 27”. 
The next exercise is simply a matter of disentangling notation. 
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Exercise 1.12. Suppose that (X,d) is a metric space and Y is a non-empty 
subset of X. 

(i) Show that, if dy(a,b) = d(a,b) for all a,b € Y, then (Y,dy) is a 
metric space. 

(ii) Show that, if (X,d) is complete and Y is closed in (X,d), then (Y, dy) 
is complete. 

(iii) Show that, if (Y,dy) is complete, then (whether (X,d) is complete 
or not) Y is closed in (X,d). 


We now come to our first real theorem. 
Theorem 1.13. The Euclidean space R” with the usual metric is complete. 


We shall usually prove such theorems in the case n = 2 and remark that 
the general case is similar. 


2 Compact sets in Euclidean Space 


In Part 1A we showed that any bounded sequence had a convergent subse- 
quence. This result generalises to n dimensions. 


Theorem 2.1. (Bolzano—Weierstrass theorem). If K > 0 and x, € R™ 
satisfies ||x,|| < Kk for allr, then we can find anx € R™ and r(k) > oo such 
that Xp(k) + X as k + oo. 


We now prove a very useful theorem. 


Theorem 2.2. (i) If E is closed bounded subset of R™, then any sequence 
x, € E has a subsequence with a limit in E. 

(ii) Conversely, if E is a subset of R™ with the property that any sequence 
x, € E has a subsequence with a limit in E, then E is closed and bounded. 


We shall refer to the property described in (i) as the Bolzano—Weierstrass 
property. 

If you cannot see how to prove a result in R™ using the Bolzano—Weierstrass 
property, then the 1A proof for R will often provide a hint. 

We often refer to closed bounded subsets of R” as compact sets. (The 
reader is warned that, in general metric spaces, ‘closed and bounded’ does 
not mean the same thing as ‘compact’ (see, for example, Exercise 19.5). 
If we deal with the even more general case of topological spaces we have 
to distinguish between compactness and sequential compactness!. We shall 
only talk about compact sets in R™.) 


‘If you intend to climb Everest you need your own oxygen supply. If you intend to 
climb the Gog Magogs you do not. 


The reader will be familiar with definitions of the following type. 


Definition 2.3. If (X,d) and (Y,p) are metric spaces and E C X, we say 
that a function f : E > Y is continuous if, given e > 0 and x € E, we can 
find a 6(a,€) > 0 such that, whenever z € E and d(z,x) < 6(x,€), we have 


p(f (2), f(@)) <€. 


Exercise 2.4. Let (X,d) and (Y,p) be metric spaces and let f : X + Y be 
a function. 

(i) f is continuous if and only if f~\(U) is open whenever U is. 

(ii) f is continuous if and only if f~'(E) is closed whenever E is. 


Even if the reader has not met the general metric space definition, she 
will probably have a good idea of the properties of continuous functions 
f: E— R’ when F is a subset of R”. 

The following idea will be used several times during the course. 


Lemma 2.5. If (X,d) is a metric space and A is a non-empty closed subset 
of X let us write 
d(x, A) =inf{d(x,a) : a€ A}. 


Then d(x, A) = 0 implies x € A. Further the map x +> d(x, A) is continuous. 
We now prove that the continuous image of a compact set is compact. 


Theorem 2.6. If E is a compact subset of R™ and f : E + R” ts continuous, 
then f(E) is a compact subset of R”. 


At first sight Theorem 2.6 seems too abstract to be useful, but it has an 
immediate corollary. 


Theorem 2.7. [f E is a non-empty compact subset of R" and f: E> R 
is continuous, then there exist a, b € E’ such that 


f(a) = f(x) 2 f(b) 
for allx € E. 


Thus a continuous real valued function on a compact set is bounded and 
attains its bounds. 


Exercise 2.8. Deduce the theorem in 1A which states that if f : [c,d] > R 
is continuous, then f is bounded and attains its bounds. 


Theorem 2.7 gives a neat proof of the fundamental theorem of algebra 
(which, contrary to its name, is a theorem of analysis). 
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Theorem 2.9. [Fundamental Theorem of Algebra] [f we work in the 
complex numbers, every non-constant polynomial has a root. 


The reader will probably have seen, but may well have forgotten, the 
contents of the next exercise. 


Exercise 2.10. We work in the complex numbers. 
(i) Use induction on n to show that, if P is a polynomial of degree n and 
a €C, then there exists a polynomial Q of degreen—1 and anr € C such 
that 
P(z) =(2—-a)Q(2) +r. 


(ii) Deduce that, if P is a polynomial of degree n with root a, then there 
exists a polynomial Q of degree n — 1 such that 


P(z) = (z— a)Q(z). 


(iit) Use induction and the fundamental theorem of algebra to show that 
every polynomial P of degree n can be written in the form 


n 


AT [e — a;) 


j=l 


with A, a1, d2,.--, A, €C and AF 0. 
(iv) Show that, if P is a polynomial of degree at most n which vanishes 
atn-+1 points, then P is the zero polynomial. 


3  Laplace’s equation 


We need a preliminary definition. 


Definition 3.1. Let (X,d) be a metric space and E a subset of X. 

(i) The interior of E is the set of all points x such that there exists ad > 0 
(depending on x) such that B(x,d) C E. We write Int E for the interior of 
E. 

(ii) The closure of E is the set of points x in X such that we can find 
en € E with en = x. We write CLE for the closure of E. 


(iit) The boundary of E is the set OF = CLE \ Int E. 


Exercise 3.2. (i) Show that Int E is open. Show also that, if V is open and 
V CE, then V Clint E. 

(ii) Show that C1E is closed. Show also that, if F is closed and F D E, 
then FD CIE. 


(Thus Int E is the largest open set contained in E and C\E is the smallest 
closed set containing E.) 

(iit) Show that OE is closed. 

(iv) Suppose that we work in R™ with the usual metric. Show that if E 
is bounded, then so is C1E. 


Recall that, if @ is a real valued function in R” with sufficiently many 
derivatives, then we write 


m Oo 
2 = Se 
as > Ox? 
jal 4 
In this section we look at solutions of Laplace’s equation 
vV7¢=0. 


Our first collection of results lead up to a proof of uniqueness. 


Lemma 3.3. Let Q be a bounded open subset of R™. Suppose 6: ClO > R 
is continuous and satisfies 

v7o>0 
on Q. Then @ cannot attain its maximum on Q. 


Theorem 3.4. Let 2 be a bounded open subset of R™. Suppose @: C1IN > R 
is continuous on C1Q and satisfies 


v7o=0 
onQ. Then ¢ attains its maximum on OQ. 
Exercise 3.5. Let Q be a bounded open subset of C. Suppose that 
f:-QN—C 


is continuous and f is analytic onQ. Recall that the real and imaginary parts 
of f satisfy Laplace’s equation on IntQ. Show that |f| attains its maximum 
on OD. 

[Hint: Why can we assume that Rf (zo) = |f(zo)| at any particular point z 7] 


Theorem 3.6. Let ) be a bounded open subset of R™. Suppose that the 
functions @,y :ClQ > R are continuous and satisfy 


V7¢ =0, V7y =0 
onQ. Then, if d6=w on OQ, it follows that @ = w on C1Q. 
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You proved a version of Theorem 3.6 in Part 1A but only for ‘nice bound- 
aries’ and functions that behaved ‘nicely’ near the boundary. 

You have met the kind of arguments used above when you proved Rolle’s 
theorem in 1A. Another use of this argument is given in Exercise 18.13 which 
provides a nice revision for this section. 

In Part 1A you assumed that you could always solve Laplace’s equation. 
The next exercise (which forms part of the course) shows that this is not the 
case. 


Exercise 3.7. (i) Let 
Q = {x € R? : 0 < |[x|] < 1}. 
Show that Q is open, that 
GIQ = {x € R? = ||x|| < 1} 
and 
dQ = {x €R® : |x|] = 1} u fo}. 
(ii) Suppose that @ : C1Q > R is continuous, that ¢ is twice differentiable 
on Q and that @ satisfies 
v7¢=0 
on 9) together with the boundary conditions 


— JO af |lxl =1, 
woo) {! ifx =0. 


Use the uniqueness of solutions of Laplace’s equation to show that @ must be 
radially symmetric in the sense that 


(x) = f(Ilxll) 


for some function f : [0,1] > R. 
(iii) Show that 


d 
ee) =0 


for0 <r <1 and deduce that f(r) = A+ Blogr [0 < r < 1] for some 
constants A and B. 
(iv) Conclude that the function @ described in (ii) can not exist. 


This result is due to Zaremba, one of the founding fathers of Polish mathe- 
matics. Later Lebesgue produced a three dimensional example (the Lebesgue 
thorn) which will be briefly discussed by the lecturer, but does not form part 
of the course. 


4 Fixed points 


In Part 1A we proved the intermediate value theorem. 


Theorem 4.1. If f : [a,b] + R is continuous function and f(a) >c> f(b), 
then we can find a y € [a,b] such that f(y) =c. 


We then used it to the following very pretty fixed point theorem. 


Theorem 4.2. [f f : [a,b] — [a,b] is a continuous function, then we can 
find aw € [a,b] such that f(w) = w. 


Notice that we can reverse the implication and use Theorem 4.2 to prove 
Theorem 4.1. (See Exercise 4.9.) 

The object of this section is to extend the fixed point theorem to two 
dimensions. 


Theorem 4.3. Let D = {x € R? : |IxI| < 1}. ff: D = D is a continuous 
function, then we can find aw € D such that f(w) = w. 


Although we will keep strictly to two dimensions the reader should note 
that the result and many of its consequences hold in n dimensions. 

Notice also that the result can be extended to (closed) squares, triangles 
and so on. 


Lemma 4.4. Let D = {x € R? : ||x|| < 1}. Suppose that g: D > A is 
a bijective function with g and g! continuous. Then if F : A > A is a 
continuous function, we can find ana € A such that F(a) =a. 


From now on we shall use extensions of the type given for Lemma 4.4 
without comment. 

The proof of Theorem 4.3 will take us some time. It consists in showing 
that a number of interesting statements are equivalent. The proof thus con- 
sists of lemmas of the form A=> BorB SC, .... I suggest that the reader 
considers each of these implications individually and then steps back to see 
how they hang together. 

We write 


D={xeER?’: |x| <1}, D={xeER?: |x|] <1},0D={x ER’ : |x|] = 1}. 


Theorem 4.5. The following two statements are equivalent. 

(i) If f : D > D is continuous, then we can find aw € D such that 
f(w) =w. (We say that every continuous function of the closed disc into 
itself has a fixed point.) 

(ii) There does not exist a continuous function g : D + OD with g(x) =x 
for allx € OD. (We say that there is no retraction mapping from D to OD.) 
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Let aj, az and a3 be unit vectors making angles of 27/3 with each other. 
We take T to be the closed triangle with vertices a,, a2 and a3 and sides J, 
J and Kk. 


(For those who insist on things being spelt out 
T = {Arai + Agag + Agaz > Ay trAe + A3 = 1, Aj > 0} 


but though such ultra precision has its place, that place is not this course.) 
The next collection of equivalences is easy to prove. 


Lemma 4.6. The following three statements are equivalent. 
(i) There is no retraction mapping from D to OD. 
(ii) Let 


T = {(cos6,sin@) : 0< 6 < 21/3}, J = {(cos6,sin@) : 21/3 < 0 < 41/3} 
and K = {(cos6,sin0) : 4m/3 <0 < 2r}. 
Then there does not exist a continuous function k:D— OD with 
k(x) €T for allx € 1, k(x) € J for allx € J, k(x) € K for allx€ K. 
(iit) There does not exist a continuous function k :T + OT with 
k(x) € I for allx € I, k(x) € J for allx € J, k(x) € K for allxe K. 
We now prove a slightly more difficult equivalence. 


Lemma 4.7. The following two statements are equivalent, 
(i) There does not exist a continuous function h: T + OT with 


h(x) € I for alixe I, h(x) € J forallxe J, h(x) € K for allxe K. 


(ii) If A, B and C are closed subsets of T with ADI, BD J andCDk 
and AUBUC=T, thn ANBNCE#S. 


We shall prove statement (ii) of Lemma 4.7 from which the remaining 
statements will then follow. The key step is Sperner’s Lemma. 


Lemma 4.8. Consider a triangle DEF divided up into a triangular grid. If 
all the vertices of the grid are coloured red, green or blue and every vertex on 
the side DE of the big triangle (with the exception of E}) are coloured red, 
every vertex of EF (with the exception of F') green and every verter of FD 
(with the exception of D) blue then there is a triangle of the grid all of whose 
vertices have different colours. 
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We can now prove the statement (ii) of Lemma 4.7 and so of Theorem 4.3 
and all its equivalent forms. 

The following pair of exercises (set as Exercises 18.7 and 18.8) may be 
helpful in thinking about the arguments of this section. 


Exercise 4.9. The following four statements are equivalent. 

(i) If f : [0,1] — [0,1] is continuous, then we can find aw € [0,1] such 
that f(w) = w. 

(ii) There does not exist a continuous function g : [0,1] + {0,1} with 
g(0) =0 and g(1) =1. (In topology courses we say that [0,1] is connected.) 

(iii) If A and B are closed subsets of [0,1] with 0 € A, 1 € B and 
AUB=(0,1] then ANBA@. 

(iv) If h: [0,1] + R is continuous and h(0) < c < h(1), then we can find 
ay € [0,1] such that h(y) =c. 


Exercise 4.10. Suppose that we colour the points r/n red or blue [|r = 
0,1,..., nm] with 0 red and 1 blue. Show that there are a pair of neigh- 
bouring points u/n, (u+1)/n of different colours. Use this result to prove 
statement (iii) of Exercise 4.9. 


Sperner’s lemma can be extended to higher dimensions and once this is 
done the remainder of our proofs together with Brouwer’s theorem extend 
with simple changes to higher dimensions. 

Here is an example of the use of Brouwer’s theorem. 


Exercise 4.11. Suppose that A = (a;;) is a 3 x 3 matrix such that a;; > 0 
for all 1 <i,j7 <3 and yo ay = for all 1<9 <3:.Let 


T={xeR’: x; 2 0 for all j and x1 + %2+ 23 = 1}. 


By considering the effect of A on T, show that A has an eigenvector lying in 
T with eigenvalue 1. 


If you have not done the 1B Markov chains course Exercise 4.11 may 
appear somewhat artificial. However, if you have done that course, you will 
see that is not. 


Exercise 4.12. (Only for those who understand the terms used. This is not 
part of the course.) Use the argument of Exercise 4.11 to show that every 3 
state Markov chain has an invariant measure. (Remember that in Markov 
chains ‘the i’s and j’s swap places’.) What result can you obtain under the 
assumption that Brouwer’s theorem holds in higher dimensions? 


Brouwer’s theorem is rather deep. Here is a result which can be proved 
using it. 
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Exercise 4.13. Show that if ABCD is a square and y is a continuous path 
joining A and C whilst T is a continuous path joining B and D, then y and 
T intersect, 

[See Exercise 18.11 for a more detailed statement and a description of the 


proof.| 


Another interesting result is given as Exercise 18.9. 


5 Non-zero sum games 


It is said that converting the front garden of a house into a parking place 
raises the value of a house, but lowers the value of the other houses in the 
road. Once everybody has done the conversion, the value of each house is 
lower than before the process started. 

Let us make a simple model of such a situation involving just two people 
with just two choices to see what we can say about it. 

Suppose that Albert has the choice of doing A; or Ag and Bertha the 
choice of doing B, or Bg. If A; and B; occur, then Albert gets a;; units and 
Bertha gets b;; units. If you went to the 1B course on optimisation you learnt 
how to deal with the case when a;; = —b;; (this is called zero-sum case since 
aj; + b;; = 0 and Albert’s loss is Bertha’s gain). Albert and Bertha agree 
that Albert will choose A; with probability p; and Bertha will choose B,; with 
probability q;. The expected value of the arrangement to Albert is 


2 2 


A(p,q) = $0 So aispig; 


i=1 j=l 
and the expected value of the arrangement to Bertha 


B(p,a) =>, 


i= 


bij Pidy 


2 
=1 


Jj 


— 


If you went to the 1B optimisation course, then you saw that in the zero- 
sum case there is a choice of p and q such that if Albert chooses p and Bertha 
q then even if he knows Bertha’s choice Albert will not change his choice 
and even if she knows Albert’s choice Bertha will not change her choice. 

So far so good, but if we consider the non zero-sum case we can imag- 
ine other situations in which Albert chooses p and then Bertha chooses q 
but, now knowing Bertha’s choice, Albert changes his choice to p’ and then, 
knowing Albert’s new choice, Bertha changes to q’ and then .... The ques- 
tion we ask ourselves is whether there is a ‘stable choice’ of p and q such 
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that neither party can do better by unilaterally choosing a new value. This 
question is answered by a remarkable theorem of Nash. 


Theorem 5.1. Suppose a,; and b;; are real numbers. Let 
E = {(p,q) :12 p, q 2 Of, 


set pj =P, P2 = Lg, a=, Q2= Legs 
2 2 

A(p,q) = 5° S- aijpiqg and B(p,q) = SS bigpiay.- 
Ae GA 


i=1 j=l 
Then we can find (p*,q*) € E such that 


B(p*,q*) = B(p*,q) for all (p*,q) € E 


and 
A(p*,q") = A(p, q*) for all (p,q*) € E. 


The pair (p*,q*) is called a Nash equilibrium point or Nash stable point. 

The interested reader should have no difficulty in convincing herself (given 
Brouwer’s fixed point theorem in the appropriate dimension) that the result 
can be extended to many participants with many choices to state that there 
is always a choice of probabilities such that no single participant has an 
incentive to change their choice?. Note that the game theory you did in 1B 
only applies to two players. 

Unfortunately the stable points need not be unique. Suppose that Albert 
and Bertha have to choose scissors or paper. If they both choose scissors 
they get £1 each. If they both choose paper they get £2 each but if they 
disagree they get nothing. It is clear that the points corresponding to ‘both 
choose paper’ and ‘both choose scissors’ are stable. The same is true if when 
they disagree they both get nothing but Albert gets £1 and Bertha £2 if 
they both choose scissors whilst, if they both choose paper the payments are 
reversed. 


Exercise 5.2. [Chicken] Albert and Bartholomew drive cars fast at one 
another. If they both swerve they both lose 1 prestige points. If one swerves 
and the other does not the swerver looses 5 prestige points and the non- 
swerver gains 10 prestige points. If neither swerves they both loose 100 points. 
Identify the Nash equilibrium points. 


?However, this applies only to single participants. There may be an incentive for two 
or more participants (if they can agree) to change their choices jointly. 
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Notice that it is genuinely easy to solve toy problems like this when they 
appear in exercises and examinations. First look at the interior of the square 
and apply elementary calculus to find stationary points. Then look at the 
interior of each edge and apply elementary calculus to find stationary points. 
Finally look at the vertices. The same idea applies when there are three 
participants, but now we need to examine the interior of the cube, the interior 
of each face, the interior of each edge and the vertices in turn. Obviously if 
we attack the problem in this way, we run into the curse of dimensionality 
— each step is easy but the number of steps increases very rapidly with the 
number of participants. So far as I know, there is no way of avoiding this 
phenomenon. (But I know of no real life situation where we would wish to 
solve a high dimensional problem.) 

It is also clear from examples like the one that began this section that 
even if the stable point is unique it may be unpleasant for all concerned’. 
However this is not the concern of the mathematician. 


6 Dividing the pot 


Faced with problems like those of the previous section, the young and ten- 
der hearted often ask ‘Why not cooperate?’ It is, of course, true that under 
certain conditions people are willing to cooperate, but, even if these condi- 
tions are met, the question remains of how to divide up the gains due to 
cooperation. 


Exercise 6.1. (You will be asked to solve this as Exercise 19.4.) Consider 
two rival firms A and B engaged in an advertising war. So long as the war 
continues, the additional costs of advertising mean that the larger firm A 
loses 3 million pounds a year and the smaller firm B loses 1 million pounds 
a year. If they can agree to cease hostilities then A will make 8 million a 
year and B will make 1 million a year. How much should A pay B per year 
to achieve this end*? 


Nash produced a striking answer to this question. There are objections 
to his argument, but I hope the reader will agree with me that it is a notable 
contribution. 


3McNamara, the US Defence Secretary at the time, was of the opinion that, during the 
Cuban crisis, all the participants behaved in a perfectly rational manner and only good 
luck prevented a full scale nuclear war. 

4The reader may feel that it would be very difficult for rival firms to come to an 
agreement in this way. In fact, it appears to be so easy that most countries have strict 
laws against such behaviour. 
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In order to examine his answer we need to introduce the notion of a 
convex set. 


Definition 6.2. A subset E of R™ is convex if, whenever u,v € E and 
1>p>0, we have 
pu+(l—p)ve E. 


Nash considers a situation in which m players must choose a point x € E 
where F is a closed, bounded, convex set in R™. The value of the outcome to 
the jth participant is x;. To see why is reasonable to take E’ convex suppose 
that the participants can choose two points u and v. The participants can 
agree among themselves to toss a suitable coin and choose u with probability 
p and v with probability 1—p. The expected value of the outcome to the jth 
participant is pu; + (1 — p)v,, that is to say, the value of the jth component 
of pu+ (1 — p)v. 

The participants also know a point s € E (the status quo) which will be 
the result if they can not agree on any other point. 

Nash argues that a best point x* if it exists must have the following 
properties. 

(1) x} > s; for all 7. (Everyone must be at least as well off as if they 
failed to agree.) 

(2) (Pareto Optimality) If x ¢ EF and x; > x; for all j, then x = x*. (If 
there is a choice which makes some strictly better off and nobody worse off, 
then the participants should take it.) 

(3) (Independence of irrelevant alternatives.) Suppose E’ is a closed 
bounded convex set with E’ D E and x™ is a best point for E’. Then, 
if x** € EF it follows that x** is a best point for EF. 

(4) If E is symmetric (that is, if whenever x € F and y1, yo,.--,Ym is 
some rearrangement of 71, 22,...,2%m, then y € E) and s is symmetric, then 
XL} = x5 =--- = 2*,. This corresponds to our beliefs about ‘fairness’. 

(5) Our final assumption is that we must treat the poor man’s penny with 
the same respect as the rich man’s pound. Suppose that x* is a best point 
for FE’. If we change coordinates and consider 


Ei ={x! : 2 = aja; +6; for 1 <j <m and x € E} 
with a; > 0, then y* with y? = a;x; + b; is a best point for E’. 


Exercise 6.3. Show that the E’ defined in (5) above is closed bounded and 
conver. 


There is no difficulty in remembering these conditions since they each 
play a particular role in the proof. If the reader prefers initially only to deal 
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with the case m = 2, she will lose nothing of the argument. We need a 
preliminary lemma. 


Lemma 6.4. Jf K is a conver set in R" such that (1,1,...,1) € K and 


TVja1 23 <1 for allx € K with xz; >0[1 <j <n, then 


KC {x : 4, +2%9+...2%n <n}. 


Theorem 6.5. Suppose that we agree to the Nash conditions. If E is closed 
bounded convex set in R™, s is the status quo point and the function f : E> 
R given by 

f(x) = []@-s;) 


jJ= 


a 


has a maximum (in E) with x; — s; > 0 at x*, then x* is the unique best 
point. 


We complete our discussion by observing that a best point always exists. 


Lemma 6.6. If E’ is closed bounded convex set in R™, s € Int E and the 
function f: E > R given by 
f(x) =|] @; - 5), 


q= 


— 


then there is a unique point in E with x;—s; > 0 where f attains a maximum. 


‘There is no patent for immortality under the the moon’ but I suspect 
that Nash’s results will be remembered long after the last celluloid copy of 
A Beautiful Life has crumbled to dust. 

The book Games, Theory and Applications [6] by L. C. Thomas maintains 
a reasonable balance between the technical and non-technical and would 
make a good port of first call if you wish to learn more along these lines. 


7 Approximation by polynomials 


It is a guiding idea of both the calculus and of numerical analysis that ‘well 
behaved functions look like polynomials’. Like most guiding principles, it 
needs to be used judiciously. 

If asked to justify it, we might mutter something about Taylor’s Theo- 
rem, but Cauchy produced the following example to show that this is not 
sufficient. 


>When we do 1A this result is a counterexample but, by Part II, if we need a ‘partition 
of unity’ or a ‘smoothing kernel’, it has become an invaluable tool. 
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Exercise 7.1. Let E: R > R be defined by 


—1/t?) ift 
E(t) = Dieu). UE, 
0 Wt 03 
(i) E is infinitely differentiable, except, possibly, at 0, with 
E(t) = P,(1/)E(t) 


for allt £0 for some polynomial P,,. 
(ii) E is infinitely differentiable everywhere with 


E™ (0) =0. 
(iit) We have 
SEO 
E(t) #S— en 
n=0 . 


for allt £0. 


(It is very unlikely that you have not seen this exercise before, but if you 
have not you should study it.) 

We could also mutter something like ‘interpolation’. The reader probably 
knows all the facts given in the next lemma. 


Lemma 7.2. Let x, 11, ..., Un be distinct points of {a, b]. 
(i) If f : [a,b] > R, then there is at most one polynomial of degree no 
greater than n with P(x;) = f(a;) forO<j<n. 
(ii) Write 
t—- Xk 
(t) = 
e;(t) I] tj) — 2p 


kAj 


If f : [a,b] > R, then 
P=)S° f(aj)e; 
j=0 
is a polynomial of degree at most n with P(a;) = f(a) forO <i<n. (Thus 
we can replace ‘at most’ by ‘exactly’ in (i).) 


(iii) In the language of vector spaces, the e; form a basis for the vector 
space of polynomials P,, of degree n or less. 


However polynomials can behave in rather odd ways. 
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Theorem 7.3. There exist polynomials T, of degree n and U,_1 of degree 
n—1 such that 
T,,(cos 8) = cos nO 


for all 6 and 
sin nd 


U,,-1(cos 6) = an 
for sin@ #0. The value of U,_1(cos@) when sin@ = 0 is given by continuity 
and will be +n. The roots of U,-1 are cos(ra/n) with 1<r<n-—1 and the 
roots of T, are cos((r+4)r/n) withO<r<n-1. 

The coefficient of t” in T, is 2°"! forn > 1. 


We call T,, the Chebychev® polynomial of degree n. The U,, are called 
Chebychev polynomials of the second kind. Looking at the Chebychev poly- 
nomials of the second kind, we see that we can choose a well behaved function 
f which is well behaved at n +1 reasonably well spaced points but whose 
nth degree interpolating polynomial is very large at some other point. It can 
be shown (though this is harder to prove) that this kind of thing can happen 
however we choose our points of interpolation. 

A little thought shows that we are not even sure what it means for one 
function to look like another. It is natural to interpret f looks like g as 
saying that f and g are close in some metric. However there are a number 
of ‘obvious’ metrics. The next exercise will be familiar to almost all my 
audience. 


Exercise 7.4. Show that the following define metrics on the space C'((0, 1]) 
of continuous functions f : [0,1] > R. 
(i) || fll = ie | f(t)| dt defines a norm with associated distance 


alfa =lW—-alh= f lf) (0a 


(ii) The equation 
(f.9) =f rteate at 


defines an inner product on C({a,b]) with associated norm || ||2 and so a 


distance 
1/2 


as(f.9) =I —ale= (fu) - teat) 


for the derived norm. 


®Or Tchebychev, hence the T. 
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(iii) The equation ||f|l.o = suprerj|f(t)| defines a norm and so a dis- 
tance 


ds(f,9) = If — glloo = ap. If) — 9(@)|- 


Show that 
IF lloo 2 |lflle 2 Il fllh- 
Let 
f(t) = fe —nt) for0O<t<1/n, 


0 otherwise. 
Compute || fnlloo/\|fnlli and || fnlli/||fnll2. Comment. 


Each of these metrics has its advantages and all are used in practice. 
We shall concentrate on the metric d3. We quote the following result from 
a previous course (where it is known as the General Principle of Uniform 
Convergence). 


Theorem 7.5. [f [a,b] is a closed interval and C(|a, |) is the space of con- 
tinuous functions on [a,b] then the uniform metric 


is complete. 


We have now obtained a precise question. If f is a continuous function can 
we find polynomials which are arbitrarily close in the uniform norm? This 
question was answered in the affirmative by Weierstrass in a paper published 
when he was 70 years old. Since then, several different proofs have been 
discovered. We present one due to Bernstein based on probability theory’. 

Before that, we need a definition and theorem which the reader will have 
met in a simpler form earlier. 


Definition 7.6. Let (X,d) and (Y,p) be metric spaces. We say that a func- 
tion f: X > Y is uniformly continuous if, given e > 0, we can find ad >0 
such that p(f(a), f(b)) <€ whenever d(a,b) < 6. 


Theorem 7.7. If E is a bounded closed set in R” and f : E > R® is 
continuous, then f is uniformly continuous. 


Although we require probability theory, we only need deal with the sim- 
plest case of a random variable taking a finite number of values and, if the 
reader wishes, she need only prove the next result in that case. 


*Some other proofs are given in Exercises 20.6, 20.7 and 20.8. It is the author’s belief 
that one can not have too many (insightful) proofs of Weierstrass’s theorem. 
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Theorem 7.8. [Chebychev’s inequality] Jf X is a real valued bounded 
random variable, then, writing 


o? = var X = E(X — EX)’, 


we have 


Pr(|X — EX| >a) < 


for alla > 0. 


Theorem 7.9. [Bernstein] Suppose f : [0,1] — R is continuous. Let 
X1, Xo, ...Xy be independent identically distributed random variables with 
Pr(X, = 0) =1—t and Pr(X, = 1) =t (think of tossing a biased coin). Let 
Xt eb 

n 


Yn(t) 


and let 


Pr(t) = Ef(Y,(¢)). 
Then 
(i) Pn 18 polynomial of degree n. Indeed, 
malt) => (7) F/nyer = 1)" 
j=0 
(it) \\Pn — f loo 40 asn—- co. 


Bernstein’s result differs from many proofs of Weierstrass’s theorem in 
giving an elegant explicit approximating polynomial. 


8 Best approximation by polynomials 


Bernstein’s theorem gives an explicit approximating polynomial but, except 
in very special circumstances, not the best approximating polynomial. (In- 
deed, we have not yet shown that such a polynomial exists.) 

Chebychev was very interested in this problem and gave a way of telling 
when we do have a best approximation. 


Theorem 8.1. [The Chebychev equiripple criterion] Let f : [a,b] — R 
be a continuous function and P a polynomial of degree at most n—1. Suppose 
that we can find a < ag < a < +++ < dn < b such that, writing o = || f—Pllo 
we have either 


f(aj) — P(aj) = (—1)%o for allO<j<n 
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or 
f(aj) — P(a;) = (-1)"t1e for all0 <j <n. 


Then ||P — flo < ||Q — flo for all polynomials Q of degree n — 1 or less. 


We apply this to find the polynomial of degree n — 1 which gives the best 
approximation to t” on [—1, 1]. 


Theorem 8.2. Write S,(t) = t” — 2'-"T,,(t), where T,, is the Chebychev 
polynomial of degree n. Then (ifn > 1) 


sup |t”— Q(t)|> sup |t” — S,(t)| =2>” 
te[—1,1] te[—1,1] 


for all polynomials Q of degree n — 1. 


Corollary 8.3. We work on [1,1]. 

(i) If P(t) = Ut_p ayt? is a polynomial of degree n with |an| > 1, then 
| Pllc = 27. 

(ti) We can find e(n) > 0 with the following property. If P(t) = S71" a,t 
is a polynomial of degree at most n and |a,x| > 1 for some n > k > 0 then 
|| Plloo 2 €(n). 


We can now use a compactness argument to prove that there does exist 
a best approximation. 


Theorem 8.4. /f f : [a,b] > R is a continuous function, then there exists a 
polynomial P of degree at most n such that ||P — flo < ||Q— flloo for all 
polynomials Q of degree n or less. 


We could also have proved Corollary 8.3 (ii) directly by a compactness 
argument without using Chebchev’s result. 

We have only shown that the Chebychev criterion is a sufficient condition. 
However, it can be shown that it is also a necessary one. The proof is given 
in Exercise 20.10 but is not part of the course. 


9 Gaussian quadrature 

How should we attempt to estimate fe f(a) dx if we only know f at certain 
points? One, rather naive, approach is to find the interpolating polynomial 
for those points and integrate that. This leads rapidly, via Lemma 7.2, to 


the following result. 
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Lemma 9.1. Let x, 441, ..., Ln be distinct points of [a,b]. Then there are 


unique real numbers Ag, Ai, ..., An with the property that 
b n 
/ P(x) dz = 5 A;P(a;) 
a j=0 


for all polynomials of degree n or less. 


However our previous remarks about interpolating polynomials suggest, 
and experience confirms, that it may not always be wise to use the approxi- 
mation 


/ f(x) du Ail (a) 


even when f well behaved. In the particular case when the interpolation 
points are equally spaced, computation suggests that as the number of points 
used increases the A; begin to vary in sign and become large in absolute value. 
It can be shown that this is actually the case and that this means that the 
approximation can actually get worse as the number of points increases. 

It is rather surprising that there is a choice of points which avoids this 
problem. Earlier (in Exercise 7.4 (ii)) we observed that the definition 


(f.9) = / falta 


gives an inner product on the vector space C([—1,1]). Let us recall some 
results from vector space theory. 


Lemma 9.2. [Gramm—Schmidt] Let V be a vector space with an inner 
product. Suppose that e1, 2, ..., €n are orthonormal and f is not in their 
linear span. If we set 


n 


v=f—) (f,e;)e;, 


j=l 
then we know that v 4 0 and that, setting en41 = ||v||~'v the vectors e1, eo, 
.., Cns1 are orthonormal. 


Lemma 9.2 enables us to make the following definition. 


Definition 9.3. The Legendre polynomials p,, are the the polynomials given 
by the following conditions®. 


’There are various other definitions, but they all give polynomials of the form bnpn. 
The only difference is in the choice of b,. As may be seen from Exercise 19.14 our choice 
is not very convenient for most uses. 
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(i) Pn ts a polynomial of degree n with positive leading coefficient. 
1 
(ii) / Dalt) pmb) dt = dan = 
224 
Lemma 9.4. The nth Legendre polynomial py has n distinct roots all lying 
in (1,1). 


Gauss had the happy idea of choosing the evaluation points to be the 
roots of a Legendre polynomial. 


1 iofin=m, 


0 otherwise. 


Theorem 9.5. [Gaussian quadrature] (i) Ifa, a2, ...a, are the n roots 
of the nth Legendre polynomial p, and the A; are chosen so that 


/ P(x) dx = 5° A;P(a,) 


1 jai 


for every polynomial P of degree n —1 or less, then, in fact 


a Q(x) dx = > AiQ(a5) 


for every polynomial Q of degree 2n — 1 or less. 
(ii) If B; € [-1,1] and B; are such that 


[ elorae = ¥° B,216;) 


for every polynomial Q of degree 2n — 1 or less, then the 8; are the roots of 
the nth Legendre polynomial. 


Theorem 9.5 looks impressive, but it is the next result which really shows 
how good Gauss’s idea is. 


Theorem 9.6. We continue with the notation of Theorem 9.5. 

(i) Aj > 0 for eachl<j<n. 

(i) et A; = 2. 

(iii) If f : [-1,1] + R ts continuous and P is any polynomial of degree 
at most 2n — 1, then 


[ dx — > Aif (a3) 


(iv) Write G,f for the estimate of Ni f(t) dt obtained using Gauss’s idea 
with the nth Legendre polynomial. Then, if f is continuous on {[—1, 1], 


1 
Guf—> f float 


<All f — Plloo- 


as n> O&O. 
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10 Distance and compact sets 


This section could come almost anywhere in the notes, but provides some 
helpful background to the section on Runge’s theorem. We start by strength- 
ening Lemma, 2.5. 


Lemma 10.1. Jf E is a non-empty compact set in R” anda € R™, then 
there is a pointe € E such that 


||a — e|| = inf |la — x||. 
xek 


As before we write d(a, E) = infxeg ||a — x||. 


Exercise 10.2. (i) Give an example to show that the point e in Lemma 10.1 
need not be unique. 
(ii) Show that, if E is convex, e is unique. 


Lemma 10.3. (i) If E and F are non-empty compact sets in R™, then there 
exist points e € E and f € F' such that 


lle— £ || = inf d{y, F). 


(ii) The result in (i) remains true when F is compact and non-empty and 
E is closed and non-empty. 
(iit) The result in (i) may fail when E and F are closed and non-empty. 


Let us write T(E, F’) = infyer d(y, F). 


Exercise 10.4. Give an example to show that the points e andf in Lemma 10.3 
need not be unique. 


The statement of the next exercise requires us to recall the definition of 
a metric. 


Definition 1.1. Suppose that X is a non-empty set and d: X? > R is a 
function such that 

(i) d(z,y) > 0 for alla, ye xX. 

(ii) d(x, y) = 0 af and only if x = y. 

(iit) d(x, y) =d(y, x) for allz,yEX. 

(iv) d(x, y) + d(y, z) > d(x, z) for allx, y,z EX. 

Then we say that d is a metric on X and that (X,d) is a metric space. 


Exercise 10.5. Show that, if we consider the space K of non-empty com- 
pact sets in R™, then 7 obeys conditions (i) and (iii) for a metric but not 
conditions (ii) and (iv). 

Show that, if E,F € K, then r(E, F) =0 if and only if ENF #2. 
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Since T does not provide a satisfactory metric on K, we try some thing 
else. If F and F' are compact sets in R™, let us set o(E, F’) = supycr dy, F). 


Exercise 10.6. Suppose that E and F are non-empty compact sets. Show 
that there exists ane € E such that d(e, F) = o(E, F). 


Exercise 10.7. Show that, if we consider the space K of non-empty compact 
sets in R™, then a obeys condition (i) for a metric but not conditions (ii) 
and (iii). 
Show that o(E, F) = 0 if and only if E C F. 
However, o does obey the triangle inequality. 
Lemma 10.8. /f E, F and G are non-empty compact sets then 
o(E,G) < o(E, F)+o(F,G). 
This enables us to define the Hausdorff metric p. 
Definition 10.9. Jf E and F are non-empty compact subsets of R™, we set 
p(B, F) = o( EF) + oP, 2), 
that is to say, 


E,F)= inf |je—f inf |le — f|]. 
PD le Stl aD a est 
Theorem 10.10. The Hausdorff metric p is indeed a metric on the space K 
of non-empty compact subsets of R™. 


Indeed, we can say something even stronger which will come in useful 
when we give examples of the use of Baire’s theorem in Section 13 


Theorem 10.11. The Hausdorff metric p is a complete metric on the space 
K of non-empty compact subsets of R™. 


Our proof of Theorem 10.11 makes use of two observations. 


Theorem 10.12. (i) Suppose that we have a sequence of non-empty compact 
sets in R™ such that 
te igee 6 ey. wee 


Then kK = (eer Ky is a non-empty compact set. 
(ii) Further, K, a K asp o. 


Lemma 10.13. [f Kk is compact in R™ so is 
K+B(0,r)={x+y:xeK, lly|| <r}. 
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11 Runge’s theorem 


The existence of two different introductory courses in complex variable is one 
of many mad things in the Cambridge system. The contents of this section 
should be accessible to anyone who has gone to either. As I shall emphasise 
from time to time, the reader will need to know some of the results from 
those courses but will not be required to prove them. 

Weierstrass’s theorem tells us that every continuous real valued function 
on [a,b] can be uniformly approximated by polynomials. Does a similar 
theorem hold for complex variable? 

Cauchy’s theorem enables us to answer with a resounding no. We write 
z for the complex conjugate of z. 


Example 11.1. Let D = {z : |z| < 1} and define f : DC by 
f(s) =2. 
If P is any polynomial, then 


sup | f(z) — p(z)| 2 1. 
zED 
After looking at this example the reader may recall the following theorem 
(whose proof does not form part of this course). 


Theorem 11.2. Jf 2 is an open subset of C and fy : Q — C is analytic, 
then if fn > f uniformly on Q (or, more generally, if fr —> f uniformly on 
each compact subset of Q) then f is analytic. 


We might now conjecture that every analytic function on a well behaved 
set can be uniformly approximated by polynomials. Cauchy’s theorem again 
shows that the matter is not straightforward. 


Example 11.3. Let T = {z : 1/2 < |z| < 2} and define f :T + C by 


f= +. 


z 
If P is any polynomial then 


sup |f() — p(z)| 2 1. 


Thus the best we can hope for is a theorem that tells us that every analytic 
function on a suitable set ‘without holes’ can be uniformly approximated by 
polynomials. 

We shall see that the following definition gives a suitable ‘no holes’ con- 
dition. 
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Definition 11.4. An open set U C C is path connected if, given z, 21 € U, 
we can find a continuous map y : [0,1] ~ U with 7(0) = z and y(1) = “1. 


We will obtain results for a bounded sets whose complement is path con- 
nected. 

The reader may ask why we could not simply use Taylor’s theorem in 
complex variables. To see that this would not work we recall various earlier 
results. (As I said earlier the proofs are not part of the course, but you are 
expected to know the results.) 


Lemma 11.5. If a; € C, then there exists an R € [0,00] (with suitable 
conventions when R = 00) such that S7°,a;z! converges for |z| < R and 
diverges for |z| > R. 


We call R the radius of convergence of aa ajz). 


Lemma 11.6. /f eee a;z) has radius of convergence R and R! < R then 
pee a;z) converges uniformly for |z| < R’. 


Lemma 11.7. Suppose that ae a;z) has radius of convergence R and that 
ye bz? has radius of convergence R'. If there exists an R" with0 < R" < 


RP such:that 
S° i= bz! 
j=0 j=0 

for all |z| < R”, then a; =; for all j. 


By a careful use of Taylor’s theorem Lemma 11.7 can be used to give the 
following extension. (The proof is not part of the course but, again, you are 
expected to know the result.) 


Lemma 11.8. Suppose that f,g : B(w,r) > C are analytic. If there is a 
non-empty open subset U of B(w,r) such that f(z) = g(z) for all z € U, it 
follows that g = f. 


Exercise 11.9. (i) Ifw 4 0, show that we can find a power series ))*  a;(z—- 
w)) with radius of convergence |w| such that 


[oe) 
gl= S° a;(z— w) 
j=0 


for all |z— w| < |w|. 


(ii) Let 
Q={z: 10? <|z|<1}\{e#:2ER, ¢<0} 


Show that Q is open, path connected and bounded and f(z) = 1/z defines a 
bounded analytic function on Q, but we can not find z and b; such that 


gis > bj(z— zo)? 


j=0 
for allz EQ. 
Let us see what Taylor’s theorem actually says. 


Theorem 11.10. [Taylor’s Theorem] Suppose that 2 is an open set in C 
and f :Q—->C is analytic. If the open disc 


B(z,6) = {z : |z — z| < 6} 


lies in Q, then we can find a; € C such that yo jL0 a;z) has radius of conver- 
gence at least 6 and 


S a;( z— 2) = f(z) 


j=0 


for all z € B(zo, 4). 


Thus Taylor’s theorem for analytic functions says (among other things) 
that an analytic function can be locally approximated uniformly by polyno- 
mials. Runge’s theorem asserts that (under certain conditions) an analytic 
function can be globally approximated uniformly by polynomials. 


Theorem 11.11. [Runge’s theorem] Suppose that Q is an open set and 
f :Q—- C is analytic. Suppose that K is a compact set with K CQ and 
C\ K path connected. Then given any € > 0, we can find a polynomial P 
with 

sup | f(z) — P(z)| <. 

zek 

I shall make a number of remarks before moving on to the proof. The 

first is that (as might be expected) Theorem 11.11 is the simplest of a family 
of results which go by the name of Runge’s theorem. However, I think that 
it is fair to say that, once the proof of this simplest case is understood, both 
the proofs and the meanings of the more general theorems are not hard to 


grasp. 
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The second remark is that the reader will lose very little understanding? if 
she concentrates on the example of Runge’s theorem for geometrically simple 
K and Q (like rectangles and triangles). 

Our proof of Runge’s theorem splits into several steps. 


Lemma 11.12. Suppose that K is a compact set with K CQ. Then we can 
find a finite set of piece-wise linear contours Cy, lying entirely within Q\ K 


such that y 
1 f(w) 
—— y ~~ d 
f(z) 271 at ee a 


whenever z € K and f:Q—- C is analytic. 
It is worth making the following observation explicit. 


Lemma 11.13. With the notation and conditions of Lemma 11.12, we can 
find ad > 0 such that |z — w| > 6 whenever z € K and w is a point of one 
of the contours Cy. 


We use Lemma 11.12 to prove the following result which takes us closer 
to our goal. 


Lemma 11.14. Suppose that K is a compact set with K CQ. Then given 
any analytic f :Q + C and any € > 0 we can find an integer N, complex 


numbers A,, Ao,..., An and ay, Q2,...,an €Q\ K such that 
N 
An 
= re 
o- Ae l<- 
forallze K. 


Thus Runge’s theorems follows at once from the following special case. 


Lemma 11.15. Suppose that K is a compact set and C\ K path connected. 
Then, given anya ¢ K and any € > 0, we can find a polynomial P with 


forallze K. 


Let us make a temporary definition. 


° And, provided she does not twist the examiner’s nose, few marks in the exam. 
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Definition 11.16. Let kK be a compact set in C. We write A(K) for the set 
of points a ¢ K such that, given any € > 0, we can find a polynomial P with 


forallze K. 


A series of observations about A(/‘) brings the proof of Runge’s theorem 
to a close. 


Lemma 11.17. Let K be a compact set in C. Then there exists an R such 
that |a| > R implies a € A(K). 


Lemma 11.18. Let K be a compact set in C. Ifa € A(K) and ja — | < 
d(a, K) then B € A(K). 


Lemma 11.19. Suppose that K is a compact set in C and C\ K is path 
connected. Then A(K) =C\K. 


Since Lemma 11.19 is equivalent to Lemma 11.15, this completes the 
proof of our version of Runge’s theorem. 

It is natural to ask if the condition of uniform convergence can be dropped 
in Theorem 11.2. We can use Runge’s theorem to show that it can not. 


Example 11.20. Let D = {z : |z| < 1} and define f : D—C by 
f (re) = 3/2 @310/2 


forr > 0 and 0 < 6 < 2n (so that f is not even continuous). Then we can 
find a sequence of polynomials P,, such that P,(z) > f(z) as n — oo for all 
Rew 


12 Odd numbers 


According to Von Neumann’? ‘In mathematics you don’t understand things. 
You just get used to them.’ The real line is one of the most extraordinary 
objects in mathematics'!. A single apparently innocuous axiom (‘every in- 
creasing bounded sequence has a limit’ or some equivalent formulation) calls 
into being an indescribably complicated object. 


10Dr Bloom suggests a a footnote in the ‘The Dancing Wu Li Masters’ by Gary Zukav 
as a source. 

NT am being modest on behalf of analysis, I suspect the real line is the most extraordi- 
nary object in mathematics. 
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We know from 1A that R is uncountable (a different proof of this fact 
will be given later in Corollary 13.8). But, if we have a finite alphabet of 
n symbols (including punctuation), then we can only describe at most n™ 
real numbers in phrases exactly m symbols long. Thus the collection of 
describable real numbers is the countable union of finite (so countable) sets 
so (quoting 1A again) countable! We find ourselves echoing Newton. 


I do not know what I may appear to the world, but to myself I 
seem to have been only like a boy playing on the sea-shore, and 
diverting myself in now and then finding a smoother pebble or a 
prettier shell than ordinary, whilst the great ocean of truth lay 
all undiscovered before me. [Memoirs of the Life, Writings, and 
Discoveries of Sir Isaac Newton Brewster (Volume II. Ch. 27)| 


Let us look at some of the prettier shells. 
Theorem 12.1. The number e is irrational. 
Theorem 12.2. The number a is irrational. 
Our proof of Theorem 12.2 depends on the following lemma. 


Lemma 12.3. If we write f,(x) = x"(a — x)” then 


1 n 
| fr(x) sine dx = mS = aj! 
0 j=0 


with a; an integer. 


Faced with a proof like that of Theorem 12.2 the reader may cry ‘How did 
you think of looking at f,(x)?’ The first, though not very helpful, answer 
is ‘I did not, I learnt it from someone else’”’. The second is that, even 
admitting that we could not have thought of it in a thousand years, once we 
are presented with the argument we can see a path (though not, I suspect, the 
actual one) which it might have been thought of. We are all familiar with the 
evaluation of ( x" sinx dx and the fact that this takes the form P(7) where 
P is polynomial of degree at most n with integer coefficients. It follows that 
if Q is a polynomial of degree n with integer coefficients then iH Q(x) sin x dx 
takes the form U(z) where u is polynomial of degree at most n with integer 
coefficients. If 7 = p/q then q”U(7) is an integer. We now experiment, trying 
to make te Q(x) sin x dx lie between 0 and 1 in the manner of our proof that 
e was irrational. 


!2Professor Gowers in this case. 
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For what it is worth, I think the restriction ‘candidates will not be required 
to quote elaborate formula from memory’ ought to mean that the examiners 
remind you of the formula for f, in a question that requires it. However, it 
is also my opinion that examiners, like umpires, are always right. 

It may be worth remembering that, after 300 years we still do not know 


if Euler’s constant 
avi 
a (25 -HaW) 


n=1 
is irrational or not. 
If we think of the rationals as ‘the best understood numbers’ then the 
algebraic numbers can be thought of as ‘the next best understood numbers’. 


Definition 12.4. We say that a real number a is algebraic if it is a zero of 
a polynomial with integer coefficients. Real numbers which are not algebraic 
are called transcendental. 


Exercise 12.5. Show that a real number a is algebraic if and only if it is a 
zero of a polynomial with rational coefficients. 


Lemma 12.6. The algebraic numbers are countable. 


Since the reals are uncountable, this shows that transcendental numbers 
exist. 

The argument just given (which you saw in 1A) is due to Cantor. It 
is beautiful but non-constructive. It tells us that transcendental numbers 
exist (indeed that uncountably many transcendental numbers exist) without 
showing us any. 

The first proof that transcendentals exist was given earlier by Liouville’. 
It is longer but actually produces particular examples. 


Theorem 12.7. [Liouville] Suppose a is an irrational root of the equation 


Ga ge ae ota = 0 


13OQnce when lecturing to a class [Kelvin] used the word ‘mathematician,’ and then 
interrupting himself asked his class: "Do you know what a mathematician is?’ Stepping 
to the blackboard he wrote upon it:— 


/ eo? /2 dy = V2. 


Then putting his finger on what he had written, he turned to his class and said: ‘A 
mathematician is one to whom that is as obvious as that twice two makes four is to you. 
Liouville was a mathematician.’ [S. P. Thompson, Life of Lord Kelvin] 
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where a; € Z|O<j <nj,n>1 anda, 40. Then there is a constant c > 0 
(depending on the a;) such that 


for allp, qE Z with q #0 
We can now exhibit a transcendental number. 


Theorem 12.8. The number 


=e. 
DS io 


j=0 


—_ 


is transcendental. 


Exercise 12.9. By considering 


er 
Loe 
with b; € {1, 2}, give another proof that the set of transcendental numbers is 
uncountable. 


3 
ll 
° 


As might be expected, it turned out to be very hard to show that particu- 
lar numbers are transcendental. Hermite proved that e is transcendental and 
Lindemann adapted Hermite’s method to show that 7 is transcendental (and 
so the circle can not be squared). Alan Baker contributed greatly to this field, 
and his book Transcendental number theory [2] contains accessible’ proofs 
of the transcendence of e and 7. 


13. The Baire category theorem 


The following theorem turns out to be much more useful than its somewhat 
abstract formulation makes it appear. 


Theorem 13.1. [The Baire category theorem] /f (X,d) is a complete 
non-empty metric space and U,, U2, ...are open sets whose complements 
have empty interior, then 


Cu, #2. 


j=l 


MBut miraculous. 
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Taking complements gives the following equivalent form. 


Theorem 13.2. If (X,d) is a complete non-empty metric space and F\, Fo, 
...are closed sets with empty interior, then 


LR zX. 


j= 
I think of Baire’s theorem in yet another equivalent form. 


Theorem 13.3. Let (X,d) be a non-empty complete metric space. Suppose 
that P; is a property such that:- 

(i) The property of being P; is stable in the sense that, given x € X 
which has property P;, we can find an € > 0 such that whenever d(x,y) < € 
the point y has the property P;. 

(ii) The property of not being P; is unstable in the sense that, given 
x € X ande > 0, we can find ay € X with d(x,y) < € which has the 
property P;. 

Then there is an % € X which has all of the of the properties P,, P2, 


Baire’s theorem has given rise to the following standard definitions!”. 


Definition 13.4. A set in a metric space is said to be nowhere dense if its 
closure has empty interior. A set in a metric space is said to be of first 
category if it is a subset of a countable union of nowhere dense closed sets. 
Any set which is not of first category is said to be of second category. 


Your lecturer will try never to use the words second category but always 
to talk about ‘not first category’. If all points outside a set of first category 
have a property P, I shall say that quasi-all points have property P. 

Two key facts about first countable sets are stated in the next lemma. 


Lemma 13.5. (i) If (X,d) is a non-empty complete metric space and E is 
a subset of first category, then EA X. 
(ii) The countable union of sets of first category is of first category. 


We need one more definition. 


Definition 13.6. (i) [f (X,d) is a metric space, we say that a point x © X 
is isolated if we can find ad > 0 such that B(x,d) = {x}. 

(ii) If (X,d) is a metric space, we say that a subset E of X contains no 
isolated points if, whenever x € E and 6 > 0, we have B(x,5)N E F {x}. 


Your lecturer thinks that, whilst the concepts defined are very useful, the nomenclature 
is particularly unfortunate. 


35 


Theorem 13.7. A non-empty complete metric space without isolated points 
is uncountable. 


Corollary 13.8. The real numbers are uncountable. 


The proof we have given here is much closer to Cantor’s original proof 
than that given in 1A. It avoids the use of extraneous concepts like decimal 
representation. 

Banach was a master of using the Baire category theorem. Here is one of 
his results. 


Theorem 13.9. Consider C([0,1]) with the uniform norm. The set of any- 
where differentiable functions is a set of the first category. Thus continuous 
nowhere differentiable functions exist. 


Here is another corollary of Theorem 13.7. 


Corollary 13.10. A non-empty closed subset of R without isolated points is 
uncountable. 


Do there exist nowhere dense closed subsets of R with no isolated points!®? 


We shall answer this question by applying Baire’s theorem in the context of 
the Hausdorff metric. 


Lemma 13.11. Consider the space K of non-empty compact subsets of |0, 1] 
with the Hausdorff metric p. Let E, be the collection of compact sets E such 
that there exists an x € E with B(x,1/k) NE = {a}. 

(i) The set E, is closed in the Hausdorff metric. 

(ii) The set E, is nowhere dense in the Hausdorff metric. 

(iit) The set E of compact sets with an isolated point is of first category 
with respect to the Hausdorff metric. 


Lemma 13.12. Consider the space K of non-empty compact subsets of |0, 1] 
with the Hausdorff metric p. Let Fj, be the collection of compact sets F’ such 
that F D [j/k, (9 +1)/k] [(O< 79 <k, 1< ki. 

(i) The set F;, is closed in the Hausdorff metric. 

(ii) The set Fj, is nowhere dense in the Hausdorff metric. 

(ii) The set F of compact sets with non-empty interior is of first category. 


Theorem 13.13. The set C of non-empty compact sets with empty interior 
and no isolated points is the complement of a set of first category in the space 
K of non-empty compact subsets of [0,1] with the Hausdorff metric p. 


16Such sets are called perfect. If they make pretty pictures they are called fractals. You 
do not have to remember either name. 
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Since K with the Hausdorff metric is complete it follows that non-empty 
compact sets with empty interior and no isolated points exist. 

The following example provides a background to our next use of Baire 
category. 


Exercise 13.14. (i) Show that we can find continuous functions gn, : [0,1] > 
R such that g,(«) > 0 for each x € [0,1] but 


SUP gn(t) + co 
te [0,1] 


as 1 — OO. 
[Hint: Witch’s hat.| 

(ii) Show that we can find continuous functions f, : [0,1] + R such that 
fr(x) > 0 for each x € [0,1] but 


sup fn(t) 4 oo 
te[2-7-1,2-7] 


as n — oo for each integer r > 0. 


In spite of the previous example we have the following remarkable theo- 
rem. 


Theorem 13.15. Suppose that we have a sequence of continuous functions 
fn: [0,1] + R such that f,(a) > 0 for each x € [0,1] asn — oo. Then we 
can find a non-empty interval (a,b) C [0,1] and an M > 0 such that 


|fn(t)| < M 
for allt € (a,b) and all n > 1. 


A slightly stronger version of the result is given as Exercise 20.11. 


14 Continued fractions 


We are used to writing real numbers as decimals, but there are other ways 
of specifying real numbers which may be more convenient. The oldest of 
these is the method of continued fractions. Suppose that x is irrational and 
1> a> 0. We know that there is a strictly positive integer N(x) such that 


ae gs a 
N(a) —" ~ N@ 41 
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sO we can write 


1 
N(x) + T(2) 
where T(x) is irrational and 1 > T(x) > 0. Thus 


ve [jm he 


. We can do the same things to T(x) as we did to x, obtaining 


i 


1 
N(T(2)) + T(L(2)) 


T(x) = 


and so, using the standard notation for composition of functions, 


1 


it 


N(@) + WG) + Ta) 


The reader!” will have no difficulty in proceeding to the next step and ob- 
taining 


1 


NEM) NaS) eas. 


the continued fraction expansion of x. [Note that, for the moment, this is 
simply a pretty way of writing the infinite sequence N(x), NT (x), NT?(2), 
.... In the next section we shall show first that the continued fraction can 
be assigned a numerical meaning and then that the assigned meaning is, as 
we might hope, z.| 


17 As opposed to typesetters; this sort of thing turned their hair prematurely grey. 
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If y is a general irrational number, we call 


NT(a) + 


1 


Bee aa eee 


the continued fraction expansion of y. 

We can do the same thing if y is rational, but we must allow for the 
possibility that the process does not continue indefinitely. It is instructive to 
carry out the process in a particular case. 


Exercise 14.1. Carry out the process outlined above for 100/37. Carry out 
the process for the rational of your choice. 


Once we have done a couple of examples it is clear that we are simply 
echoing Euclid’s algorithm”. 


Lemma 14.2. (i) Suppose that rz, 8% are coprime positive integers with 
rE < Sp; that rpii, 8% are coprime strictly positive integers with rei < Sp41- 
and that a, 1s a strictly positive integer. If 


Tk 1 


om Ap + eel 
Sk+1 
then Sp41 =r 
Sk = GkSk41 + Tk+1 
for some positive integer ki. Thus the pair (rg41, 541) 1s obtained from 
(rx, Sx) by applying one step of the Euclidean algorithm. 
(ii) If y is a rational number, its continued fraction expansion (obtained 
by the method described above) terminates. 


Exercise 14.3. Show that /2 has continued fraction expansion 


Deduce that \/2 is irrational. 


187 think historians would reverse the order and say that continued fractions gave rise 
to Euclid’s algorithm 
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If we look at a random variable with the uniform distribution on [0, 1] 
then the successive terms in the decimal expansion of X will be independent 
and will take the value j with probability 1/10 [0 < 7 < 9}. 


Exercise 14.4. (This easy exercise formalises the remark just made.) If 
x € [0,1) let us write Dx = 10x — [102] (in other words, Dax is the fractional 
part of 10x) and Nx = [102]. Show that 


«= 107'(Dz + Nx) = 10°'Nz +10 ?NDzx + 107D?z =... 


and write down the next term in the chain of equalities explicitly. 
If X is a random variable with uniform distribution on [0,1], show that 
NX, NDX, ND?X,... are independent and 


Pr(ND*X = j) = 1/10 
for0<7 <9. 
Gauss made the following observation. 


Lemma 14.5. Suppose that X is a random variable on {0,1) with density 


function 
1 1 
ie) = (as) l+a 


Then TX is a random variable with the same density function. 


Corollary 14.6. Suppose that X is a random variable on [0,1] with density 
function 
1 1 
Ia) = (as) l+a 
Then 


Wi . 2 
Pr(NT™X = j)=— if a : tog (YO). 
1 


= _ 0, Apa 
log2 Jisga1) 1 +2  log2 aj + 2) 
Proof. By Lemma 14.5, 
PNT S97) = Ft Ve = 7) 


1 Gaye 
= aa | da 
log 2 1+2 


jul 


jot 


1 
ees pr are 
all og( v) (j+1)-? 


— (log(j + 2) — log(j + 1)) = <= log 


es Ene 
~ log 2 ~ log 2 


gj+1 
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With a little extra work (which we shall not do) we can show that, if 
X has the density suggested by Gauss, then NX, NTX, NT?X, ...are 
independent random variables all with the same probability distribution. It 
is also not hard to guess, and not very hard to prove, that if Y is uniformly 
distributed on [0, 1], then 


1 (+1) 
Pr(NT”’Y = ] : 
r( I) pga ee CS 


as m — oo, but we shall not take the matter further. 


15 Continued fractions (continued) 


In the previous section we showed how to compute the continued fraction 
associated with a real number x, but we did not really consider what exact 
meaning was to be assigned to the result. In this section we show that 
continued fractions do what we might hope they do. 


Definition 15.1. If a,, ao, ...is a sequence of strictly positive integers and 
dy is a positive integer we call 


ag + 


a3 + 
: a4+... 


the continued fraction associated with a = (do, a1, @2,...). 


Lemma 15.2. (i) We use the notation of Definition 15.1. If we take 
Tr = An; Sp = 1 


and define r, and s;, in terms of rey, and Sp44 


Tr\ _ (ae 1) (Trt 
Sk 1 OF \SpaiJ)’? 


Al 


then 
1 


(ii) If we set 


So 
then 
To 1 
=a 
SO es 1 
aya I 
a2 4 i 
a3 { rl 
a4 t 


An-1 Pa 
n 


We now read everything off in the opposite direction 


Lemma 15.3. (i) If we set 


On 
then 
Pn 1 
Gee 1 
ay } l 
ag t 1 
a3 1 
a4 
An—1 + — 
An 
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(ii) Further 


Pn Pn-1\ __ (4 1\ far 1) (an-1 1\ fa 1 
Gi Gas 1. 0 1 0 I> OE Oe? 


The pay-off for our work in recasting matters in matricial form comes in 
the next theorem. 


Theorem 15.4. Choose p; and q; as in Lemma 15.3. 
(i) Pek—1 — U%Pr—-1 = (—1)**1 for all k. 
(it) Ue = Akdr—1 + kg and Py = AbPe—-1 + Pr—2 for all k = 2. 
(iit) py and gy, are coprime for all k. 


(iv) We have 
P2k ne P2k-2 P2k-1 S P2k+1 


b) 
q2k G2k-2 =2k-1 G2k4+1 


and 
1 


: ket 


Pk Pr+i 
Gk = Qk41 


(uv) Suppose a; is a sequence of strictly positive integers for 7 > 1 and ag 
is a positive integer. Then there exists an a € R such that 


Further 


< ; 
dn Qndn+1 


Pe — al 1 
a 


Exercise 15.5. Suppose we have an irrational x € (0,1] and we form a 
continued fraction (with ay = 0) 


a3 + 


a4 +... 
in the manner of Section 14. Show that 


2k 2k-1 
Pak yc Pek-1 
q2k G2k-1 


for all k and deduce that x = a where a is the value of the associated con- 
tinued fraction. 
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Theorem 15.6. Continuing with the ideas and notation of Theorem 15.4, 
Pn/Gn ts Closer to a than any other fraction with denominator no larger than 
dn. In other words, 


Pn | 
—-a 
Qn 

whenever p and q are integers with 1 <q < dn. 


Theorem 15.7. [fx is irrational, we can find uy and vy, integers with Up, > 
oo such that 


This result should be compared with Theorem 12.7. We give another 
proof of Theorem 15.7 in Exercise 21.5. We give a slight improvement in 
Exercise 21.9. 


Exercise 15.8. Which earlier result tells us that, if a is the irrational root 
of a quadratic with integer coefficients, then there exists a C (depending on 
a) such that 


u (e 

poz 

v v? 
whenever u and v are integers with v > 1? 


We can treat ‘terminating continued fractions’ and rationals in the same 
way. 

Speaking rather vaguely, we see that the occurrence of large a,’s in a 
continued fraction expansion gives rise to large q,,’s and associated good 
approximations. It is reasonable to look at the most extreme opposite case. 


Exercise 15.9. (i) Show that, if we write 


1 
G= : 
1 
14 
1+ : 
1+ : 
Ta: 
then 
1+ v5 
ey, 
2 
(ii) Show that, if we form pp and qn in the usual way for the continued 
fraction above, then py = Fr, dn = Frayi where F,, is the mth Fibonacci 


number given by Fo = 0, Fi = 1 and 
Fat = Pigg Pt 
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(iii) Show that 
Fu Fa — F2 = (-1)". 


Exercise 15.10. Use the continued fraction expansion of o and Theorem 15.6 
to show that there exists an m > 0 such that 


Sand: ae 


q q 


whenever p and q are integers with q > 1. 
Exercise 21.10 gives a more general version of this idea. Exercise 21.11 (vit) 
suggests a better estimate for m. 


Exercise 15.11. In one of Lewis Carroll’s favourite puzzles an 8 x 8 square 
is reassembled to form a 13x 5 rectangle as shown in Figure 1. 


Figure 1: Carroll’s puzzle 


What is the connection with Exercise 15.9? Can you design the next 
puzzle in the sequence? 


Hardy and Wright’s An Introduction to the Theory of Numbers [5| con- 
tains a chapter on approximation by rationals in which they show, among 
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other things, that o is indeed particularly resistant to being so approximated 
by rationals. If I was asked to nominate a book to be taken away by some 
one leaving professional mathematics, but wishing to keep up an interest in 
the subject, this book would be my first choice. 


16 A nice, but starred, formula 


This section is non-examinable 

The notion of a continued fraction can be extended in many ways. 

We are used to the idea of approximating functions f by polynomials P. 
Sometimes it may be more useful to approximate f by a rational function 
P/Q where P and Q are polynomials. If we approximate by polynomials we 
are led to look at Taylor series. If we approximate by rational functions it 
might be worth looking at some generalisation of continued fractions. 

Here is a very pretty formula along these lines. 


x 
tanz = 


The following theorem of Lambert makes the statement precise. 


Theorem 16.1. Jf we write 


m—3— 
i | 


then R,(x) + tanx asn—> oo for all real x with |x| < 1. 
In order to attack this we start by generalising an earlier result 


Exercise 16.2. Suppose that a; and b; [j = 0,1,2,...] are chosen so that 
we never divide by zero (for example all strictly positive). Show that if 


Pn DnPa—1 = ao bo ay by An Oi 
Qn PnQn—1 a 1 0 ill 0 rr 1 0 : 
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then 


Show that 


Pn = AnPn-1 7 bn—1Pn—2 


Gn = Andn-1 1 On On3. 


We now use the following result which is clearly related to the manipula- 
tions used in Lemma 12.3. 


Lemma 16.3. Let us write 


‘2 1 
Onn! 


Sn(z) / (a? — t*)” cost dt. 


Then S;,(a) = dn(x) sin x — p,(x) cosa where py and qn satisfy the recur- 
rence relations 


Dali) = (2n — 1)Pn—1(2) _ P05 5a); 
Gn(x) ea (2n _ 1)dn—1(2) ~~ ©" Gn—2(2) 
for n > 2 and po(x) = 0, g(x) = 1, pi(z) = 2, i(x) = 1. 


The results of this section and other interesting topics are discussed in a 
book [3] which is a model of how a high level recreational mathematics text 
should be put together. 


17 Winding numbers 


We all know that complex analysis has a lot to say about ‘the number of 
times a curves goes round a point’. In this final section we make the notion 
precise. 


AT 


Theorem 17.1. Let 
P={26¢ © y |e;= 1}. 


If g : [0,1] > T is continuous with g(0) = ec, then there is a unique 
continuous function @ : [0,1] > R with 0(0) = 0 such that g(t) = e® for 
ali t € (0, 1]. 


The uniqueness part of Theorem 17.1 follows from the next exercise. 


Exercise 17.2. Suppose y, ¢: [0,1] > R are continuous with e&?© = ee 
for allt € [0,1]. Show that there exists an integer n such that w(t) = o(t) + 
2na for allt € [0,1]. 


Corollary 17.3. [fy : [0,1] + C \ {0} is continuous with (0) = |y(0)|e, 
then there is a unique continuous function 6 : [0,1] + R with 0(0) = 0 such 
that y(t) = y(le@. 


Definition 17.4. [fy : [0,1] + C \ {0} and @: [0,1] > R are continuous 
with y(t) = |7(t)|e®, then we define 


6(1) — (0) 


Exercise 17.2 shows that w(y,0) does not depend on the choice of 0. 


Exercise 17.5. (i) If y : [0,1] + C \ {0} ts continuous and y(0) = (1) 
(that is to say, the path is closed) show that w(y,0) is an integer. 

(ii) Give an example to show that, under the conditions of (i), w(y, 0) 
can take any integer value. 


We are only interested in the winding number of closed curves. 
If a € C, it is natural to define the winding number round a of a curve 
given by a continuous map 


7: [0,1 > C\ ta} 


to be 
w(y; a) = wy — a, 0), 


but we shall not use this slight extension. 


Lemma 17.6. If, y2 : [0,1] + C \ {0} then the product 712 satisfies 


w(W172; 9) = w(1, 0) + wy, 0). 
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Lemma 17.7. [Dog walking lemma] /f 7, 72 : [0,1] - C \ {0} are con- 
tinuous, y1(0) = 71(1), 12(0) = y2(1) and 


lne(@)| < In) 
for all t € [0,1], then y+ 72 never takes the value 0 and w(y1 + 72,0) = 
wy, 0). 


Many interesting results in ‘applied complex analysis’ are obtained by 
‘deforming contours’. The idea of ‘continuously deforming curves’ can be 
made precise in a rather clever manner. 


Definition 17.8. Suppose that yo, 71 are closed paths not passing through 0 
(so we have, 7; : [0,1] + C\{0}). Then we say that yo is homotopic to 7 by 
closed curves not passing through zero if we can find a continuous function 
T: [0,1]? + C \ {0} such that 

T'(s,0) =T(s,1) for all s € (0, 1], 
P(0, t) = y(t) for allt € [0,1], 
T(1,t) = u(t) for allt € [0,1]. 
We often write y,(t) = ['(s, t). 


Exercise 17.9. [fy and y satisfy the conditions of Definition 17.8, we 
write yo ~ 71. Show that ~ is an equivalence relation on closed curves not 
passing through zero. 


The proof of the next theorem illustrates the utility of Definition 17.8. 
The proof itself is sometimes referred to as ‘dog walking along a canal’. 


Theorem 17.10. [fy andy satisfy the conditions of Definition 17.8, then 
w(70,0) = w(1, 0). 


As before, let us write 


DeIeei eg) 1k 
D={zeEC: |z| <1}, 
OD ={zEC + |z|= 1}. 


Corollary 17.11. Suppose f : D > C is continuous, f(z) 4 0 for z € OD, 
and we define y : [0,1] ~ C by 


y(t) = f(e™") 
for allt € [0,1]. If w(y,0) £0, then there must exist a z € D with f(z) = 
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This gives us another proof of the Fundamental Theorem of Algebra (The- 
orem 2.9). 


Corollary 17.12. If we work in the complex numbers, every non-trivial poly- 
nomial has a root. 


We also obtain a second proof of Brouwer’s theorem in two dimensions 
in the ‘no retraction’ form of Theorem 4.5.) 


Corollary 17.13. There does not exist a continuous function f : D —+ OD 
with f(z) =z for all z € OD. 


The earlier combinatorial proof that we gave requires less technology to 
extend to higher dimensions. 

The contents of this section show that parts of complex analysis are really 
just special cases of general ‘topological theorems’. On the other hand, other 
parts (such as Taylor’s theorem and Cauchy’s theorem itself) depend crucially 
on the the fact that we are dealing with the very restricted class of functions 
which satisfy the Cauchy-Riemann equations. 

In traditional courses on complex analysis, this fact appears, if it appears 
at all, rather late in the day. Beardon’s Complex Analysis [4] shows that it 
is possible to do things differently and is well worth a look!’. 
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18 Question sheet 1 


Note The Pro-Vice-Chancellor for Education has determined that the amount 
of work required by a student to understand a course should be the same as 
that required by any other student. Traditionally, teachers and students in 
the Faculty of Mathematics have interpreted this as meaning that each ex- 
ample sheet should have exactly twelve questions. The number of questions 
in the example sheets for this course may be reduced to twelve by omitting 
any marked with a %. 


Exercise 18.1. (i) Consider R”. If we take d to be ordinary Euclidean distance 


h 1/2 
d(x, y) = ||k— yl = (> 25 — ul] 


j=1 


show that (R",d) is a metric space. 
[Hint: Use inner products.] 

(ii) Consider C. If we take d(z,w) = |z—w|, show that (C, d) is a metric 
space. 

(iii) Let X be a non-empty set. Check that, if we write 


dea) 0 ifx=y, 
Xx = 
es 1 ife@Fy, 


then (X,d) is a metric space (d is called the discrete metric). 
(iv) Consider X = {0,1}”. If we take 


d(x,y) = Ds lz; — yl, 


show that (X,d) is a metric space. 


Exercise 18.2. (i) Give an example of a continuous bijection f : R > R with 
no fixed points. 

(ii) If A is an infinite countable set, show that there exists a bijection 
f : A— A with no fixed points. What can you say if A is finite non-empty 
set? (Be careful to cover all possible cases.) 

[Remark: We can replace ‘infinite countable’ by ‘infinite’ provided we 
accept the appropriate set theoretic axioms. | 
Exercise 18.3. (i) Show that a subset F of R™ (with the usual metric) is 
compact if every continuous function f : E — R is bounded. 

(ii) Show that a subset E of R™ (with the usual metric) is compact if 
every bounded continuous function f : E > R attains its bounds. 
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Exercise 18.4. Suppose that d is the usual metric on R™, X is a compact 
set in R™ and f : X > X is a continuous distance increasing map. In other 
words, 


d(f(x), fly)) = d(x, y) 


for all x, y € X. The object of the first two parts of this question is to show 
that f must be a surjection. 

(i) Let f(x) = 2 f"(e) = f(f"(@)). Explain why Xoo = Ay F(X) 
is compact and why the map g : Xx. + Xoo is well defined by f(g(y)) = y. 

(ii) If z € X, consider the sequence f"(z). By using compactness and 
part (i) show that given € > 0 we can find an w € X. such that d(w, z) < e. 
Deduce that f is surjective. 

(iii) Let X = {a € R : x > O}. Find a continuous function f : X > X 
such that | f(x) — f(y)| > 2|2 —y| for all z, ye X but f(X) 4 X. Why does 
this not contradict (ii)? 

(iv) We work in C. Let a be irrational and let w = exp(27az). If 


iv Sha ay, 
find a continuous function f : X — X such that |f(w) — f(z)| = |w — 2| for 
all w, z € X but f(X) 4 X. Why does this not contradict (ii)? 


Exercise 18.5. A function f : R” — R is called upper semi-continuous if, 
given x € R” and € > 0, we can find a 6 > 0 such that 


IIx -— yl <6 => fly) < f(x) +6. 


(i) If E is a subset of R” and we define the indicator function Ig by 


a(x) 1 ifxe&, 
>. oa 
7 0 otherwise, 


show that Ig is upper semi-continuous if and only if F is closed. 

(ii) State and prove necessary and sufficient conditions for —Ig to be 
upper semi-continuous. 

(iii) If f : R’ > R is upper semi-continuous and K is compact show that 
there exists a z € K such that f(z) > f(k) for allk € K. (In other words f 
attains a maximum on K.) 

(iv) If g: R > R is defined by 


_ f-l/le| ifs £0, 
H= 4, ifz =0, 


show that g is upper semi-continuous but that g is unbounded on [—1, 1]. 
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Exercise 18.6. Let 


H={zEC: Rz>0}, 
H={zeEC: Rz>0}, 
Y={zeC: |z| <1}, 
D={zeEC: |z| <1}. 


(i) Does every bijective continuous map f : C > C have a fixed point? 

(ii) Does every bijective continuous map f : Hl — H have a fixed point? 
(iii) Does every bijective continuous map f : H > H have a fixed point? 
( 
( 


iv) Does every bijective continuous map f : D — D have a fixed point? 
v) Does every bijective continuous map f : D > D have a fixed point? 
Give reasons for your answers. 


Exercise 18.7. (Exercise 4.9) Show that the following four statements are 
equivalent. 

(i) If f : [0,1] — [0,1] is continuous, then we can find a w € [0,1] such 
that f(w) = w. 

(ii) There does not exist a continuous function g : [0,1] > {0,1} with 
g(0) = 0 and g(1) = 1. (In topology courses we say that [0,1] is connected.) 

(iii) If A and B are closed subsets of [0,1] with 0 € A, 1 € B and 
AUB=(0,1] then ANBF @. 

(iv) If h : [0,1] + R is continuous and h(0) < c < A(1), then we can find 
ay € [0,1] such that h(y) =. 
Exercise 18.8. (Exercise 4.10) Suppose that we colour the points r/n red or 
blue [r = 0, 1, ..., mn] with 0 red and 1 blue. Show that there are a pair of 
neighbouring points u/n, (u+ 1)/n of different colours. Use this result to 
prove statement (iii) of Exercise 4.9. 


Exercise 18.9. Suppose that g : R? > R? is a continuous function such that 
there exists a K > 0 with ||g(x) — x|| < K for all x € R’. 

(i) By constructing a function f : R? > R?, taking a disc into itself, and 
such that 

f(t) =t = g(t) =0 

show that 0 lies in the image of g. 

(ii) Show that, in fact, g is surjective. 

(iii) Is it necessarily true that g has a fixed point? Give reasons. 

(iv) Is g necessarily injective? Give reasons. 


Exercise 18.10. Use the Brouwer fixed point theorem to show that there is a 
complex number z with |z| < 1 and 


ge 2 Bs" le 1 0. 
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Exercise 18.11. Consider the square S = [—1,1]?. Suppose that 6, : 
[—1,1] — S are continuous with 8(—1) = (-1,-1), 8) = (,1), y(-1) = 
(—1,1), y(1) = (1,-1). The object of this question is to show that there 
exist (so,to) € [-1,1]? such that 8(so) = y(to). (Note that this is just a 
formal version of Exercise 4.13.) 

Our proof will be by contradiction, so assume that no such (so, to) exists. 
We write 


B(s) = (Gr(s), Ba(s)), V(t) = (mi(#), r2(¢)) 

(i) Show carefully that the function F': S > S given by 
-1 

max{|1(s) — 71(#)|, [F2(s) — ye(t)|} 


is well defined and continuous. 

(ii) Show by considering the possible values of the fixed points of F’ or 
otherwise that F’ has no fixed points, Brouwer’s fixed point theorem now 
gives a contradiction. 


F(s,t) = (81(s) — v(t), B2(s) — r2(¢)) 


Exercise 18.12. Here is a variation on Lemma 4.7 (ii). It can be proved in 
the same way. 

Suppose that 7, J, J, K are as in Lemma 4.7 and that A, B and C' are 
closed subsets of T’ with 


AUBUCE=T, 
AUBDI, BUCDJ, CUADK, 
ASKAI BST Ad-C OTA. 


Show that ANBNC #2. 


Exercise 18.13. % Cantor started the researches which led him to his studies 
of infinite sets by looking at work of Riemann on trigonometric series. He 
needed to show that if F': [a,b] + R is continuous and 


F(a +h) —2F(x)+ F(a —h) 
he 


+0 


as h — 0 for all x € (a,b) then F is linear. (Note that there are no differen- 
tiability conditions on F'.) Schwarz was able to supply a proof. 
(i) Suppose that F’ : [a,b] + R is continuous, F(a) = F(b) and there 
exists an € > 0 such that 
F(e+h)—2F (x2) + F(x —h) = 


lim sup 72 >e 
h-0 
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for all x € (a,b). Show that F cannot attain a maximum at any x € (a,)). 
Deduce that 
F(z) < F(a) 


for all x € [a, b). 
(ii) Suppose that F’: [a,b] > R is continuous, F(a) = F'(b) and 


yaa F(a2+h) —2F(2) + F(z —h) 


>0 
h—0 Ae — 


for all x € (a,b). Let c = (a+b)/2. By considering G(x) = F(x)+¢(x—c)?/4 
or otherwise, show that 
F(z) < F(a) 
for all x € [a, }]. 
(iii) Suppose that F’ : [a,b] > R is continuous, F(a) = F'(b) and 


ad F(x +h) —2F(x2)+ F(a —h) 


h0 h2 Jy 


for all x € (a,b). By considering F' and —F' show that 


for all x € [a, b). 
(iv) Show that if F': [a,b] + R is continuous and 


F(2+h)—2F(2)+ F(z —h) 


he +0 


as h — 0 for all x € (a,b) then F is linear. 


Exercise 18.14. % As usual D is the closed unit disc in R? and QD its 
boundary. Let us write 


A={(x,y)¢D?: x#y} 


and consider A as a subset of R* with the usual metric. We define F : A > 
OD as follows. 

Given (x,y) € I, take the line from x to y and extend it (in the x to y 
direction) until it first hits the boundary at z. We write F'(x,y) =z. 

In the proof of Theorem 4.5 I claimed that it was obvious that F’ was 
continuous. Suppose, if possible, that g : D > D is a continuous map with 
g(x) #x for all x € D. Explain why, if my claim is true, the map 


XH F(x, g(x)) 
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is a continuous map. 

The claimed result is obvious (in some sense) and you may take it as 
obvious in the exam. However, if we can not prove the obvious it ceases to 
be obvious. This question outlines one method of proof, but, frankly, the 
reader may find it easier to find their own method. Any correct method 
counts as a solution. 

(i) Suppose that 0 < yo < 1, zo > 0 and 22 + y2 = 1. Show that, given 
€ > 0 we can find an 7 > 0 such that if 27+ y? = 1, x > 0 and |y— yo| < 7 
implies ||(x, y) — (20, yo) || < €. - 

(ii) Suppose that (21, yo), (v2, yo) € D, yo > 0 and x; # x. By using (i), 
or otherwise, show that, given any « > 0, we can find a 0 > 0 such that, 
whenever 


Mei. 4) — (t. 9M Ie, 92) — (v2, y) || < 6 
and (x4, 4), (x,y) € D, we have (21, y,) 4 (74, yh) and 


F (2,01), (2, ¥2)) = (u,v) with |v — yl <e. 


(iii) Hence show that fF: A > D is continuous. 
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19 Question sheet 2 


Exercise 19.1. In the two player game of Hawks and Doves”’, player i chooses 
a probability p; which announce publicly. Players may change their mind 
before the game begins but must stick to their last announced decision. 

Once the game begins, player 7 becomes a hawk with probability p; and 
a dove with probability 1 — p;. Two doves divide food so that each gets V/2. 
A hawk scares off a dove so the hawk gets V and the dove 0. Two hawks 
fight, the winner gets V — D and the looser —D (D is the damage). The 
probability of winning such an encounter is 1/2 for each bird. 

If V > 2D show that there is only one Nash equilibrium point. Give a 
simple explanation of this fact. 

If V < 2D show that there are three equilibrium points and identify them. 

What happens if V = 2D? 


Exercise 19.2. (i) Suppose that E is a compact convex set in R", that a : 
R” > R” is linear and b € R™. Show that 


{b+ax:xe Ek} 


is compact and convex. 
(ii) Suppose that E is a compact convex set in R”, that f : R" — R”™ is 
continuous and b € R™. Set 


B' ={b+ f(x): xe E} 


(a) Is E” necessarily convex if n = 1? 

(b) Is E” necessarily convex if m= 1? 

(c) E” necessarily convex for general m and n? 
Give reasons. 


Exercise 19.3. (If you have done the 1B optimisation course.) We use the 
notation of Theorem 5.1. Suppose that a;; = —b,;, that is to say that Albert’s 
gain is Bertha’s loss. Explain why the 1B game theoretic solution will always 
be a Nash equilibrium point and vice versa. 


Exercise 19.4. (This is Exercise 6.1) Consider two rival firms A and B en- 
gaged in an advertising war. So long as the war continues, the additional 
costs of advertising mean that the larger firm A loses 3 million pounds a year 
and the smaller firm B loses 1 million pounds a year. If they can agree to 
cease hostilities then A will make 8 million a year and B will make 1 million 


20This has nothing to do with the question but I cannot resist passing on the information 
that TfL employs hawks to clear its larger stations of pigeons. The hawks actually catch 
pigeons, but are not allowed to eat them, because London pigeons have too many diseases. 
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a year. How much does Nash say should A pay B per year to achieve this 
end/ 
[One way of doing this is to apply an affine transformation] 


Exercise 19.5. Consider the continuous functions on [0,1] with the uniform 
norm. Show that the unit ball 


{f € C([0,1]) = Wflloo < 1} 


is a closed bounded subset of the complete space (C'([0, 1]), || ||.0), but is not 
compact. 


Exercise 19.6. (i) Let f : [0,1] + R be a continuous function which is not 
a polynomial. If p, is a polynomial of degree d, and p, — f uniformly on 
[0, 1], show that d,, > oo. 

[Hint. Look at Corollary 8.3.] 

(ii) If g, is a polynomials of degree e,, with e, — co and gq, — g uniformly 
on [0,1], does it follow that g is not a polynomial? Give reasons. 


Exercise 19.7. Show that no formula of the form 
1 n 
/ f(t)dt = > Aj f(2;) 
-1 sem 


(with «;, A; € R) can hold for polynomials f of degree at most 2n. 


Exercise 19.8. Let f : [0,1] > R and g: [—1,1] > R be continuous. 
(i) By using the Weierstrass approximation theorem, show that 


1 
| x" f(x) dx = 0 for all n > 0 => f is the zero function. 
0 


(ii) Show that 
1 
fi a” f(a) dx = 0 for alln >0= f is the zero function. 
0 


(iii) Is it true that if fo xn*! f(x) dx = 0 for all n > 0, then f must be 
the zero-function? Give reasons. 

(iv) Is it true that, if ie x?"g(x) dx=0 for all n > 0, then g must be the 
zero-function? Give reasons. 


Exercise 19.9. (i) (This just to remind you that discontinuous functions come 
in many shapes and sizes.) Let f : R — R be given by f(x) = sin1/z for 
x #0 and f(0) =a. Show that, whatever the choice of a, f is discontinuous. 
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(ii) Does there exist a discontinuous function g : [0,1] + R which can be 
approximated uniformly by polynomials? Why? 

(iii) Does there exist a smooth function h : R > R which cannot be 
approximated uniformly by polynomials? Prove your answer. 

(iv) If f : R > R is continuous, does there always exist a sequence of 
polynomials p,, with p,(x) > f(x) for each x as n > oo. 


Exercise 19.10. We say that a function f : R — R has the intermediate value 
property if whenever a,b € R and f(a) > c > f(b) we can find a t in the 
closed interval with end points a and b such that f(t) =. 

(i) Give an example of a function satisfying the intermediate value prop- 
erty which is not continuous. 

(ii) Show that if f has the intermediate value property and in addition 
f—'(q) is closed for every a in a dense subset of of R then f is continuous. 


Exercise 19.11. %& Are the following statements true or false? Give reasons. 

(i) If f : (0,1) > R is continuous, we can find a sequence of polynomials 
P,, converging uniformly to f on every compact subset of (0,1). 

(ii) If g : (0,1) — R is continuously differentiable we can find a sequence 
of polynomials Q, with Q!, converging uniformly to g’ and Q,, converging 
uniformly to g on every compact subset of (0,1). 

(iii) If h : (0,1) > R is continuous and bounded we can find a sequence 
of polynomials R, with 


sup |R,(t)| < sup |A(t)| 
te(0,1) te(0,1) 


converging uniformly to h on every compact subset of (0, 1). 


Exercise 19.12. % Compute the Chebychev polynomials T,, of the first kind 
for n = 0,1,2...,4 and the Chebychev polynomials U,,_, of the second 
kind forn =1,2..., 4. 

Recall that we say that a function f;[—1,1] > R is even if f(x) = f(—2) 
for all « and odd if f(x) = —f(—2) for all x. 

Explain why we know, without calculation, that the Chebychev polyno- 
mials 7;, are even when n is even and odd when n is odd. What can you say 
about the Chebychev polynomials U,, of the second kind? 


Exercise 19.13. The Chebychev polynomials are orthogonal with respect to 
a certain non-zero positive weight function w. In other words, 


for allm #n. Use a change of variables to find a suitable w. 
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Exercise 19.14. %& (i) Use the Gramm-—Schmidt method (see Lemma 9.2) to 
compute the Legendre polynomials p, for n = 0, 1, 2, 3, 4. You may leave 
your answers in the form A,p, (i.e. ignore normalisation). 
(ii) Explain why we know, without calculation, that the Legendre poly- 
nomials p, are even when n is even and odd when n is odd. 
(iii) Explain why 
d™ 
da™ 
vanishes when x = 1 or x = —1 whenever m < n. 
Suppose that 


(l1—2)"(1+ 2)” 


nm 


~ dan 


Use integration by parts to show that 


LAS) (1 — 2)". 


for m # n. Conclude that the P, are scalar multiple of the Legendre poly- 
nomials pp. 

(iv) Compute P,, for n = 0, 1, 2, 3, 4 and check that these verify the last 
sentence of (iii). 

(iv) Let u,(2) = 2”. Find the choice of v which minimises 


1 1/2 
Jon —olla= ( fle" - v(@)PPae) 
=i 


for v a polynomial of degree at most n — 1 


Exercise 19.15. Are the following statements true or false. Give reasons. 
(i) For all n > 1, there exists a polynomial P,, of degree at most n such 
that 
P,,(cosht) = cosh nt. 


(ii) For all n > 1 there exists a polynomial Q,, of degree at most n such 
that 
Qn(cosht) = sinh nt. 


(iii) For all n > 1 there exists a polynomial R,, of degree at most n such 
that 
R,,(sint) = sin nt. 


Exercise 19.16. % (i) Suppose f : [a,b] > R is continuous and « > 0. Why 
can we find an infinitely differentiable function g : [a,b] — R such that 


If — gllo <€ 
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(ii) By using Chebychev polynomials and Weierstrass’s approximation 
theorem, show that given any continuous f : [0,7] > R and any « > 0 we 
can find N and a; € RO < 7 < N such that 


<eé 


f(s) - S° a; COS js 


N 
j=0 


for all s € [0, 7]. 
(iii) Let e > 0. If f : [0,7] > R is continuous with f(0) = 0, show that 
we can find N and b; € RO <j < N such that 


f(s) — bos — S° b; sin js 


j=0 


N 
<e€ 


for all s € [0, 7]. 
(iv) Let e > 0. If f : [0,7] > R is continuous with f(0) = f(7) = 0, show 
that we can find N and b; € R, 0 <7 < N such that 


<e 


N 
i — S 0b; sin js 
j=0 


for all s € [0,7]. 
(v) Hence show that, given any continuous f : [—7,7] > R with f(—7) = 
f(a) and any € > 0, we can find N and aj, 3; € R such that 


N N 
i — S © b; cos jt — S > cj sin jt 
j=0 j= 


<e 


for all ¢ € [—a, 7]. 
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20 Question Sheet 3 


Exercise 20.1. Let f : [-1,1] > R be a function and let M > 0. Show that 
there exists at most one polynomial of degree n such that 


f(x) — P(a)| < Mla/"" 


for all x € [-1, 1]. 
Must there always exist such a P if f is everywhere infinitely differentiable 
and we choose M sufficiently large? 
Exercise 20.2. Let T; be the jth Chebychev polynomial. Suppose that y; is 
a sequence of non-negative numbers such that i 7; converges. Explain 
why et 7;T3: converges uniformly on [—1, 1] to a continuous function f. 
Let us write P, = De 7,13). Show that we can find points 


—-1l<% < 4% <... < Ggnt1 <1 
such that 


F(x) — Pale) =(-1)**? Soy. 
j=n+1 
Exercise 20.3. Use Exercise 20.2 to show that, given any decreasing sequence 
dn — 0, we can find a continuous function f : [—1, 1] > R such that (writing 
|| ||.o for the uniform norm on [—1, 1}) 


inf{|| ff — Pll. : Pa polynomial of degree at most n} > dn. 


Why does this not contradict the Weierstrass approximation theorem? 
Exercise 20.4. Use the ideas of Theorem 7.9 to show that, if f : [0,1]? ~ R 
is continuous, then, given € > 0, we can find a polynomial P in two variables 
such that 

lf(z,y) — P(z,y)| <e 
for all x, y € [0, 1]. 
Exercise 20.5. (Not very much to do with the course but a nice question which 
you should have met at least once in your life.) Suppose f : [-1,1]? ~ R 
is a bounded function such that the map «+> f(x,y) is continuous for each 
fixed y and the map y+ f(x,y) is continuous for each fixed x. By means of 
a proof or counterexample establish whether f is necessarily continuous. 


The next three questions give alternative proofs of Weierstrass’s theorem. 
Each involves some heavy lifting, but each introduces ideas which are very 
useful in a variety of circumstances. If you are finding the course heavy going, 
or your busy social schedule limits the time you can spend thinking to an 
absolute minimum, you can skip them. If you want to do any sort of analysis 
in the future they are highly recommended. 
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Exercise 20.6. Here is an alternative proof of Bernstein’s theorem using a 
different set of ideas. 
(i) Let f € C((0,1]). Show that given « > 0 we can find an A > 0 such 
that 
f(a) + A(é— 2)’ + €/2> f(t) = f(w) — A(t— 2)’ — €/2 
for all t, x € [0, 1]. 
(ii) Now show that we can find an N such that, writing 


he(t) = f(r/N) + AG —r/N)’, gr(t) = f(r/N) — Ar /NY, 


we have 

gn(t) +> f(t) > helt) —¢ 
for |t —r/N| < 1/N. (You may find it helpful to draw diagrams here and 
in (iii).) 

(iii) We say that a linear map S : C([0,1]) — C([0,1]) is positive if 
F(t) > 0 for all t € [0, 1] implies SF(t) > 0 for all t € [0,1]. Suppose that S$ 
is such a positive linear operator. Show that if F(t) > G(t) for all t € [0, 1], 
then (SF)(t) > (SG)(t) for all t € [0,1] [F, G € C([0, 1])]. Show also that if, 
F €C((0,1)), then ||SFloc < ||S1bool Flee 

(iv) Write e,(t) = t’. Suppose that S,, is a sequence of positive linear 
functions such that ||S,e, — e-||o — 0 as n > oo for r = 0, r = 1 and 
r = 2. Show, using (ii), or otherwise, that ||S,f — fll. 4 0 as n — oo for 
all f € C((0, 1). 

(v) Let 

(SO = (")sG/mea- or" 
j=0 J 
Verify that S,, satisfies the hypotheses of part (iv) and deduce Bernstein’s 
theorem. 


Exercise 20.7. % Here is another proof of Weierstrass’s theorem which is 
closer to his original proof. We wish to show show that any continuous 
function function f : [-1/2,1/2] — R can be uniformly approximated by 
polynomials on [—1/2, 1/2]. To do this we show that any continuous function 
g: R > R with g(x) = 0 for |az| > 1 can be uniformly approximated by 
polynomials on [—1/2, 1/2]. Why does this give the desired result? 
Let 
ae i — x7)" for |z| © 7 
0 otherwise, 


let 


and let K,(x) = A7z'Ly (2). 
(i) Show that 


Pio) = he Foe) = [ K,,(a — t)g(t) dt 


is a polynomial in x on the interval [—1/2, 1/2] It may be helpful to recall 
that fxg = 9* f.) 
(ii) Let 6 > 0 be fixed. Show that K,,(a) > 0 uniformly for |z| > 6 and 


5 
if K,(2)dt > 1 
5 


as N —> 00. 
(iii) Use the fact that g is bounded and uniformly continuous together 
with the formula 


5 
Ria = if K,,(t)g(a — t) ar+ | K,,(t)g(a — t) dt 
—6 t€(—6,6) 
to show that P,(«) > g(x) uniformly on [—1/2, 1/2]. 


Exercise 20.8. Here is another proof of Weierstrass’s theorem, this time due 
to Lebesgue. 

(i) If a < b sketch the graph of |x — al — |x — 8}. 

(ii) Show that if g : [0, 1] > R is piece-wise linear, then we can find n > 1, 
A; € R and a; € [0,1] such that 


g(t) =o + > Ajlt— ay]. 
j=l 


Deduce that, given f : [0,1] > R and € > 0, we can find n > 1, A; € R and 
a; € [0,1] such that 


<€. 


i =Do= 5. Ajlt= al 
j=l 


wo-af(0+5)-(-5) 


Explain using results on the general binomial expansion (which you need not 
prove) why u,, can be uniformly approximated by polynomials on [—2, 2]. 


(iii) Let 
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Explain why wu,,(t) — |¢| uniformly on [—2,2] as n > oo. Deduce that 
there exist polynomials g, with q,(t) + |t| uniformly on [—1, 1] as r > oo. 

(iv) Use (ii) and (iii) to prove the Weierstrass approximation theorem. 
[Lebesgue’s idea provides the basis for the proof of the more general Stone— 
Weierstrass theorem. ] 


Exercise 20.9. (This will look less odd if you have done the previous exercise.) 

(i) Let a sequence of distinct x, form a dense subset of [0,1] with xo = 0, 
x, =1. If f € C([0,1}), define f, : [0,1] — R to be the simplest piece-wise 
linear function with f,(z;) = f(z;) for 0 < 7 < n. Show that f, — f 
uniformly. 

(ii) Use (i) to show that there exists a sequence of continuous functions 
@n such that, for each f € C({0,1]) there exists a unique sequence a, such 
that 


S> aj; = f 
j=0 


uniformly on [0, 1]. 
[In practice the sequence x; is usually taken to be 0, 1, 1/2, 1/4, 3/4 1/8, 
3/8, 5/8, 7/8,1/16, 3/16, ....] 
Exercise 20.10. % In Theorem 8.4 we saw that, if f : [a,b] > R is a con- 
tinuous function there exists a polynomial P, of degree at most n — 1, such 
that ||P — flo < ||Q — fll. for all polynomials Q degree n or less. The ob- 
ject of this question is to show that the polynomial P satisfies the equiripple 
criterion. 

We claim that we can find a < ay < ay < +++ <a, < b such that, writing 
o =||f — Pll we have either 


f(a;) — Pla;) = (—1)%o for allO<j<n 
or 
f(a;) — P(a;) = (-1)*'o forall 0°29. <n 


Our proof will be by reductio ad absurdum. 

We assume without loss of generality that [a,b] = [0,1] and o = 1. 

(i) Write g = f — P. Explain why we can find an integer N > 1 such 
that, if 1<r< N, at least one of the following statements must be true 


g(x) > 1/2 for all x € [(r —1)/N,r/N], 


g(x) < —1/2 for all x € [(r — 1) /N,r/N], 
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|g(x)| < 3/4 for all x € [(r — 1)/N,r/N]. 


(ii) Using the result of (i), show that, if our putative theorem is false, we 
can find an integer q < n, integers 


0 =u(1) < v(1) < u(2) < (2) <---< u(g) < vg) =N 
and w € {0,1} such that 
(—1)”’*39(x) > —1 for all x € [u(j)/N, v(j)/N] 
\g(x)| < 1 for all x € [v(7)/N, u(y + 1)/N). 


Without loss of generality, we take w = 0. 
(iii) Explain why we can find an 7 > 0 with 


(-1))9(x) > —1 +7 for all x € [u(j)/N, v(j)/N] 
|9(z)| < 1—7 for all x € [v(7)/N, uj + 1)/N], 


for all 7. We may take 7 < 1/8 and will do so. 
(iv) Explain how to find a polynomial R of degree n or less with || R]|,. = 1 
such that 
(—1) R(x) > 0 for all x € [u(j)/N, vy) /N] 
and 7 = 1,2,...,4q. 
(v) Show that 
|g(x) — (n/2)R(@)| <1 —n/2 


for all x € [0,1]. Hence obtain a contradiction. 
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Exercise 20.11. Suppose that we have a sequence of continuous functions 
fr : [0,1] + R such that f,(x) > 0 for each x € [0,1] as n > oo. Then, 
given € > 0, we can find a non-empty interval (a,b) C [0,1] and an N(e) such 
that 

lfn(é)| S€ 
for all t € (a,b) and all n > N(e). 
Hint Consider the sets 


En = {x € [0,1] : |fn(x)| < ¢, for all n > N}. 
Exercise 20.12. Suppose that f : [l,oo) — R is a continuous function and 


f (nz) + 0 as n > oo for each x € [1, 00). Show that f(x) > 0 as £ > oo. 


Exercise 20.13. % (i) Consider C({0,1]) with the uniform norm. If M is 
strictly positive integer, let Ej, be the set of f € C([0, 1]) such that whenever 
N > 1 and 

O< 4% <4 <a4%9<...< ayn <l 


we have 


Show that €), is closed with dense complement. Deduce that there is a set G 
which is the complement of a set of first category such that, given any f € G 
and any M > 1, we can find N > 1 and 


O< 4% <4 <4%o<...< ay <l 


with 


Me 


Fa) SF (ae) ae 


& 
lI 
ar 


(ii) Show that there is a set H which is the complement of a set of first 
category such that, given any f € H, any a and b with0O <a<b< 1 and 
any M > 1, we can find N > 1 and 


a<%<@<%<...< an <b 
with 
| f(@5-1) — fla;)| > M. 


Me 


j=l 
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Exercise 20.14. Let h : [0,1] + R be a continuous strictly increasing function 
with h(0) = 0. We say that a compact set F is thin if, given « > 0, we can 
find a finite collection of intervals J; of length J; [N > j > 1] such that 


N N 
EC\)h;, but So h(i) <e. 
j=l j=l 


Show that the set C of thin compact sets is the complement of a set of 
first category in the space K of compact subsets of [0, 1] with the Hausdorff 
metric p. 

Exercise 20.15. % Let A={zeC: 1/2 < |z| <1} andlet D={zeC: 
|z| < 1}. Suppose that f : A — C is analytic and we can find polynomials 
Pn With pp(z) > f(z) uniformly on A. Show that we can find an analytic 
function g: D > C with f(z) = g(z) for all z € A. 

[Hint: Use the maximum modulus principle and the general principle of 
uniform convergence.| 

Exercise 20.16. (i) We work in C. Show that there exists a sequence of 
polynomials P,, such that 


1 if |z)<landRz>0 
Py(z) > 
0 if |z|< land Rz <0 


as N —> Oo. 
[Hint: Recall that, if Q] and Q, are disjoint open sets and f(z) = 0 for z € Qy 
and f(z) =1 for z € Qo, then f is analytic on Q) UQ2.] 

(ii) Show that there exists a sequence of polynomials Q,, such that 


1 ifRz>0 
Qnlz) > f Te ceeal 


as 2 —> OO. 
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21 Question sheet 4 


Exercise 21.1. By quoting the appropriate theorems, show that, if Q is an 
open set in C, then f : Q — C is analytic if and only if, whenever K is a 
compact subset of Q with path-connected complement and « > 0, we can 
find a polynomial P with | f(z) — P(z)| < for all z € K. 


Exercise 21.2. In this exercise we suppose that K is a bounded compact 
subset of C and F is a non-empty bounded connected component of C \ Kk. 
Give a simple example of such a kK and FE. Our object is to show that if 
a € E the function f(z) = (z—a)7! is not uniformly approximable on K by 
polynomials. 

Suppose P is a polynomial with |p(z) — (z — a)~'| < € or all z € K. 
By observing that the boundary OE of E lies in K and using the maximum 
modulus principle deduce that |p(w)(w — a) — 1| < esup,ex |z — a]. By 
choosing w appropriately deduce that € > (sup,ex |z — al)". 


Exercise 21.3. Show that cos 1 is irrational. Show more generally that cos 1/n 
is irrational whenever n is a non zero integer. 


Exercise 21.4. Use the idea of Louiville’s theorem to write down a continued 
fraction whose value is transcendental. Justify your answer. 


Exercise 21.5. Let us write (y) = y — [y] so that (y) is the fractional part of 


y 
Suppose that x is irrational. If m is strictly positive integer consider the 


m+ 1 points 
= (00) SCL seo AR) y clon A) 


and explain why there must exist integers r and s with0O <s<r<mand 
\(r2) — (sx)| <1/m. 
Deduce that we can find an integer v with 1 < v < mand and integer u with 
jux —u| <1/m 


and so with 


~ mv v2 
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Exercise 21.6. Determine the continued fraction expansion of 71/49 and use 
your result to find the rational number with denominator no greater than 10 
which best approximates 71/49. 


Exercise 21.7. (i) Determine the continued fraction expansions of VJ/3. 

(ii) Explain why the form of the continued fraction shows that V3 is 
irrational. 

(iii) Let pp/dn be the nth convergent for V3. Compute (pp/gdn)? for n = 
1, 2,3, 4,5. 


Exercise 21.8. Let a and b be strictly positive integers. If 


show that ax? + abr —b = 0 


Exercise 21.9. If x is irrational, we can find u, and v, show that we can find 
integers with v, — oo such that 


[Hint: Show that, in fact, at least one of the convergents Pp/Gn OY Pn41/Qn+1 
must satisfy the required inequality. 


Exercise 21.10. Show that if all the integers a, in the continued fraction 


a3 + 
: Gat... 


are bounded, then there exists an M > 0 such that 


r--|>—= 
q| 


A M 
for all integers p and q with q # 0. 
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Exercise 21.11. The Fibonacci sequence has many interesting aspects. (It 
is, so far as I know the only series with its own Fanzine — The Fibonacci 
Quarterly.) 

(i) Find the general solution of the difference equation 


Un+1 = Un + Un-1- 


The Fibonacci series is the particular solution F,, = uy, with ug = 0, uy = 1. 
Write F;, in the appropriate form. 
(ii) Show, by using (i), or otherwise, that ifn > 1, F, is the closest integer 


ay ion 

v5\ 2 | 
_14+Vv5 
C= 5D 


to 


We call 


the golden ratio. 
(iii) Prove the two identities 


Pong = Fy + Fy 
Fo, = Fi(Fh-1 + Fi4i) 


by using the result of (i). 
(iv) Explain why 


Pda E, an 
& e)=4 


a 


Use the result A”™™ = A" A™ to deduce that 


where 


Pap — iy by Ee 
Pisin di ea ia ey Pate 


Obtain (iii) as a special case. 

(v) Let t, = Frii/Fn. Use (iii) to express x2, as a rational function of 
Lis 

(vi) Suppose now we take y, = Xx. Write down y,+1 as a rational 
function of y,. Use (i) to show that yz converges very rapidly to 7. Can you 
link this with the Newton—Raphson method for finding a root of a particular 
function? 


rel 


(vii) What is the relation between 7 and the o of Exercise 15.9. Use the 
result of part (i) to obtain an estimate for 
Fi, 
Fee 


correct to within a constant multiple of 04”. 


Exercise 21.12. Let p(z) = 2? —4z +3 and let 7: [0,1] > C be given by 
4(t) = p(2e?""). Show that closed path associated with y does not pass 
through 0. 

Compute w(7, 0) 

(i) Non-rigorously direct from the definition by obtaining enough infor- 
mation about y, (You could write the real and imaginary parts of y(t) in 
terms of cost and sint.) 

(ii) by factoring, and 

(iii) by the dog walking lemma. 

Exercise 21.13. % Suppose that 7 : [0,1] + C \ {0} is a continuously differ- 
entiable function with (0) = 7(1). 
If we define r : [0,1] — C by 


wo -eo([98.) 


compute the derivative of r(t)/y(t) and deduce that 


w(7,0) = : i: aS) ds 


~ Qni Sy (8) 


Use this result and the residue theorem to compute w(y,0) in Exer- 
cise 21.12. 
[The example used in the last two questions has been chosen to make things 
easy. However, if you are prepared to work hard, it is possible to obtain 
enough information about y to find the winding number of closed curves 
even in quite complicated cases. If many winding numbers are required (as 
may be the case when studying stability in an engineering context then we 
can use numerical methods (this question suggests a possibility, though not 
necessarily a good one) together with the knowledge that the winding number 
is an integer to obtain winding numbers on an industrial scale.| 


Exercise 21.14. % Take your electronic calculator out of your old school 
satchel (or use the expensive piece of equipment on which you play games) 
and find the first few terms of the continued fraction for 7 (or, more strictly 


ie 


for the rational number that your calculator gives when you ask it for 7.) 
Compute first few associated convergents (what we have called 3 + pn /dn). 

Verify that 355/113 is an extremely good approximation for 7 and explain 
why this is so. Apparently the approximation was first discovered by the 
astronomer Tsu Ch’ung-Chih in the fifth century A.D. 

The entries a, in the continued fraction expansion for 7 look, so far as 
anyone knows, just like those you would expect from a random real number 
(in a sense made precise in Corollary 14.6). 

I would be inclined to say that this was precisely what one should expect 
if there was not a beautiful expansion (using a generalisation of the kind of 
continued fraction discussed in the course) found by Lord Brouncker in 1654. 


T i 
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2 
Lo eae 


You may easily verify that the first convergents are 


1 a 
ie Pe et 
3 3° 5 


and, if your name is Euler, that the nth convergent is 


and then, if your name is Leibniz, you will prove the result 


Me 
bo | ~ 
| 
nan 
" 
QS 


Laat 
ja. © 


j=0 


The convergence is, however, terribly slow and it is no wonder that Huygen’s 
initially disbelieved Brouncker’s result. 
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Gaussian quadrature, 24 
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homotopy, 49 


interior, 7 
isolated point, 35 


Legendre polynomials, 23 


lunacy, Cambridge, 27 


metric space 
complete, 4 
convergence, 3 
definition, 3 
examples, 3 


Nash stable points, 14 
nowhere dense, 35 


open set, 4 


Pareto optimality, 16 
path connected, 28 
Tw irrational, 32 


quasi-all, 35 
retraction mapping, 10 


second category, 35 

solution of Laplace’s equation 
possible non-existence, 9 
uniqueness, 8 

Sperner’s lemma, 11 


Taylor series, counterexample, 18 
uniformly continuous, 20 


Weierstrass’s approximation theorem 
Bernstein’s proof, 21 
other proofs, 62 

winding number, 48 

witchs’ hats, 37 


Zaremba’s counterexample, 9 
zero-sum game, 13 
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